This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie
There is a growing need for citizens to be able to work with data and consider how data is represented. This work employs a design, make, play framework to create data modeling learning experiences for young children and their caregivers in an informal setting. The project develops and tests a curriculum for a workshop series for 5-8 year old children to engage them in playful exploration of data modeling. Children engage in data collection, data representation, and data analysis by drawing on their own experiences of museum exhibitions. The curriculum supports developing children's interest and engagement with data science and data literacy, which are foundational knowledge for a range of STEM careers and disciplines. This project advances efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM).
The project is grounded in a theoretical framework for young children's learning that focus on playful exploration, design, and building on children's own experiences and questions. The research examines how the curriculum needs to be designed to support families in data modeling, foster engagement in data modeling by both younger (ages 5-6) and older (ages 7-8) children, and provide evidence of active approaches to learning about STEM. The design and development project tests and investigates the materials using a design-based research framework. Children who participate in the workshop series should increase their confidence in solving problems, taking initiative, and drawing on available resources to pursue their own questions and respond to novel challenges. Data collected includes interviews with participants, artifacts of children's work throughout the series, and an observational instrument to document families' problem solving, persistence, and engagement with data science concepts.
Designing Our World (DOW) was a four-year NSF-funded initiative in which the Oregon Museum of Science and Industry (OMSI) sought to promote girls’ pursuit of engineering careers through community-based programming, exhibition development, and identity research. The overarching aim of DOW was to engage girls ages 9–14 with experiences that illuminate the social, personally relevant, and altruistic nature of engineering. In addition to programming for girls, the project also included workshops for parents/caregivers, professional development for staff from community partners; and an exhibition
MobiLLab is a mobile science education program designed to awaken young people’s interest in science and technology (S&T). Perceived novelty, or unfamiliarity, has been shown to affect pupils’ educational outcomes at similar out-of-school learning places (OSLePs) such as museums and science centers. A study involved 215 mobiLLab pupils who responded to three surveys: a pre-preparation, at-visit, and post-visit survey. Results provide evidence for four dimensions of pupils’ at-visit novelty: curiosity, exploratory behavior, oriented feeling, and cognitive load. Findings also show that classroom
In March of 2016, the Exploratorium transmitted a live webcast of a total solar eclipse from Woleai, a remote island in the southwestern Pacific. The webcast reached over 1 million viewers. Evaluation reveals effective use of digital media to engage learners in solar science and related STEM content.
Edu, Inc. conducted an external evaluation study that shows clear and consistent evidence of broad distribution of STEM content through multiple online channels, social media, pre-produced videos, and an app for mobile devices. IBM Watson did a deep analysis of tweets on eclipse topics that
EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
In March of 2016, a total solar eclipse occurred in the southwestern pacific; and in August of 2017, a total solar eclipse occurred across a broad swath of the United States. The Exploratorium launched a 2.5 year public education program—Navigating the Path of Totality—that used these two total solar eclipses as platforms for sparking public engagement and learning about the Sun, heliophysics, and the STEM content related to both. These sequential eclipses provided an unprecedented opportunity to build and scaffold public engagement and education. Our strategy was to start the public engagement process with the 2016 eclipse, nurture that engagement with resources, activities and outreach during the 17 months between the eclipses, so that audiences (especially in the U.S., where totality was visible in multiple areas across the country) would be excited, actively interested, and prepared for deeper engagement during the 2017 eclipse. For the August 2017 eclipse, the Exploratorium produced live telescope and program feeds from Madras, OR and Casper, WY. The Exploratorium worked with NASA to leverage what was a once-in-a-lifetime experience for millions to bring heliophysics information and research to students, educators, and the public at large through a variety of learning experiences and platforms.
The core of this project was live broadcasts/webcasts of each eclipse. To accomplish these objectives, the Exploratorium produced and disseminate live feeds of telescope-only images (no commentary) of each eclipse originating them from remote locations; produce and disseminate from the field live hosted broadcasts/webcasts of each eclipse using these telescope images; design and launch websites, apps, videos, educator resources, and shareable online materials for each eclipse; design and deliver eclipse themed video installations for our Webcast studio and Observatory gallery in the months that lead up to each eclipse and a public program during each eclipse; and conduct a formative and summative evaluation of the project.
These broadcasts/webcasts and pre-produced videos provide the backbone upon which complementary educational resources and activities can be built and delivered. Programs and videos were produced in English and Spanish languages. As a freely available resource, the broadcasts/webcasts also provide the baseline content for hundreds if not thousands of educational efforts provided by other science-rich institutions, schools, community-based organizations, and venues. Platforms such as NASA TV and NASA website, broadcast and online media outlets such as ABC, NBC, CBS, CNN, MSNBC and PBS, as well as hundreds of science institutions and thousands of classrooms streamed the Exploratorium eclipse broadcasts as part of their own educational programming, reaching 63M people. These live broadcasts were relied upon educational infrastructure during total solar eclipses for institutions and individuals on the path and off the path alike.
As a part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings. This Broad Implementation project would scale up the CryptoClub Project, an afterschool and online program designed to engage middle school youth in mathematics and cryptography. The project builds on previous successful work and evaluation that is ready for scale up using a train-the-trainer model implemented through a partnership with the National Girls Collaborative. The project will train 160 new CryptoClub leaders who will then train 800 new leaders at 20 hub sites reaching 9600 students. In addition, professional development modules and webinars will continue to refresh leader skills. Other project components include an online multiplayer cryptography game, weekly challenges through social media, and digital cryptology badges for students.
The research uses a think-aloud method with students as they actually attempt to solve the cryptology problems using mathematical thinking. Three think-aloud studies will be performed during the Project. The research team will code transcripts of the interviews for evidence of the mathematical thinking intended to be addressed by each activity, as well as capturing unexpected kinds of thinking. Tasks will also be rated according to the type of knowledge elicited. A written report will include statistical analyses of the think-aloud and interview responses, interpreted in light of the overall CryptoClub goals. The findings will contribute to both future research efforts and practice. The evaluation by EDC uses a quasi-experimental design, which assesses project outcomes for trainers, leaders, students, and Internet users. EDC will also investigate the fidelity to the CryptoClub model as it is scaled up. These studies have strong potential for informing numerous other projects that are at a stage where scale up is under consideration.
“The Roads Taken” virtual conference was part of a three-phase research project designed to explore the very long-term impact of STEM youth programs (such as the iconic YouthALIVE program). In this first phase, a virtual conference was held to engage youth program practitioners in the development and testing of a Program Profile prototype, a structured document that helps institutions to characterize their own youth programs in useful ways.
Following the webinars and the completion of the Program Profile by each organization, participants were asked to complete a brief survey (included as
Many environmental communication interventions are built on the assumption that increased knowledge will lead to changes in proenvironment behaviors. Our study probes the link between biodiversity-related knowledge and self-reported proconservation behavior, based on the largest and most international study of zoo visitors ever conducted. In total, 6,357 visitors to 30 zoos from 19 countries around the globe participated in the study. Biodiversity understanding and knowledge of actions to help protect biodiversity were significantly related, but only 0.6% of the variation in knowledge of
Video has become a key tool for scientific communication because it increases the outreach and impact of projects, furthers scientific research within and across fields of study, and offers an accessible medium to engage the public in the understanding of science. This project supports the expansion of an interactive, online STEM Videohall where hundreds of NSF-funded researchers share their work through brief video narratives and interactive discussion. While the Videohall is accessible year-round, periodic annual Showcase events are used to drive visitors to the site where they can engage with one another, the project investigators and trained facilitators. The Videohall is a multiplier of NSF's investments in individual projects because it allows STEM education researchers to become aware of, and learn from, related work that is funded across NSF programs and directorates, and other federal agencies. In 3-minute video narratives, investigators share ideas, resources, data, evidence of impact, strategies and challenges. The Videohall platform supports open access and is designed to foster communication in ways that scale beyond traditional formats such as academic conferences. Moreover, because the online STEM Videohall is open to the public, it allows STEM investigators to share their work with multiple stakeholder communities including K-12 educators and school leaders, informal educators and community organizations, the STEM industry, education policy makers and families. Finally, because each video narrative is accompanied by a facilitated online discussion thread, investigators have a unique and valuable mechanism for receiving feedback from these various stakeholder communities. The STEM Videohall project is funded by the Discovery Research K-12 program (DRK-12), which seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.
This project brings together seven NSF-funded resource centers who work with their respective communities to encourage Principal Investigators to share video narratives of their work through annual NSF STEM Showcase events. Each annual Showcase event presents videos created by 150-230 projects; many of the projects are affiliated with one of the seven resource centers, but others are from projects across NSF directorates and beyond. During a one-week period, Principal Investigators, their project staff, as well as the public at large, are invited to engage in interactive discourse, providing queries, comments, and feedback. Participants also vote for favorite presentations through "Presenters' Choice," "Public Choice," and "Facilitators' Choice," processes. This participant voting system serves to increase engagement and enhances outreach of the event through social media. After the one-week Showcase event concludes, all of the videos along with the related discourse remain available to the public online, who continue to access the Showcase throughout the year. Based on prior pilot work, it is estimated that over the course of a year, over 30,000 visitors, from over 150 countries, will engage with each annual Showcase. Videos from annual showcase events will be shared, reused, and repurposed to create new products with new constituencies. The project includes technical development efforts to iteratively improve its interactive platform, outreach efforts before each annual Showcase event, facilitation of the week-long event, and intensive dissemination efforts. A research component examines the extent of participation on various constituencies, the benefit of participation to projects, and the success of the events in terms of dissemination nationally and internationally.
This longitudinal research study will contribute to a broader understanding of the pathways of STEM-interested high school students from underrepresented groups who plan to pursue or complete science studies in their post-high school endeavors. The project will investigate the ways that formative authentic science experiences may support youth's persistence in STEM. The study focuses on approximately 900 urban youth who are high interest, high potential STEM students who participate in, or are alumni of, the Science Research Mentoring Program. This program provides intensive mentoring for high school youth from groups underrepresented in STEM careers. It takes place at 17 sites around New York City, including American Museum of Natural History, which is the original program site. Identifying key supports and obstacles in the pathways of high-interest, under-represented youth towards STEM careers can help practitioners design more inclusive and equitable STEM learning experiences and supports. In this way, the project will capitalize on student interest so that students with potential continue to persist.
In order to understand better the factors that influence these students, this research combines longitudinal social network and survey data with interviews and case studies, as well as an analysis of matched student data from New York City Public Schools' records. The research questions in the study are a) how do youths' social networks develop through their participation in scientists' communities of practice? b) what is the relationship between features of the communities of practice and youths' social networks, measures of academic achievement, and youths' pursuit of a STEM major? and c) what are the variations in youth pathways in relationship to learner characteristics, composition of social networks, and features of the community of practice? The research design allows for a rich, layered perspective of student pathways. In particular, by employing social network analysis, this study will reveal relational features of persistence that may be particularly critical for underrepresented youth, for whom STEM role models and cultural brokers provide an otherwise unavailable sense of belonging and identity in STEM. The study will also access a New York City Public Schools data set comprised of student-level records containing biographical and demographic variables, secondary and postsecondary course enrollment and grades, exam scores, persistence/graduation indicators, linked responses to post-secondary surveys, and post-education employment records and wages. These data enable examination of inter-relationships between in-school achievement and out-of-school STEM experiences through comparison of program participants to similar non-participant peers. This project is supported by NSF's EHR Core Research (ECR) program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field.