This document is the final summative evaluation report written by EDC, the external evaluator of the STEM Guides project. The report concludes that the project was highly ambitious, with many dynamic and evolving pieces. It was deemed successful as a model of brokering connections between students aged 10-18 and STEM resources and opportunities in rural Maine communities. The STEM Guides program contributed to the increase in STEM awareness within each community, as well as connecting youth with interesting and relevant STEM experiences.
Project SYSTEMIC (A Systems Thinking Approach to STEM Ecosystem Development in Chicago) will apply systems thinking to a community-level STEM ecosystem development effort in one of Chicago's largest and most distressed neighborhoods. The project aims to broaden participation of African American and low-income Chicago Public School students (preK-12) in STEM learning opportunities. The proposed model of collaborative change for this project builds on the work of two coordinated collective impact initiatives--the Chicago STEM Pathways Cooperative and Austin Coming Together, a network of local organizations committed to improving educational and economic outcomes for the community. A key feature of this project is that it adds innovative, interactive, visual problem structuring and solving strategies to highlight and uncover the systemic interdependencies that contribute to the BP challenge for African American youth. The project will convene a series of workshops to engage community stakeholders in the mapping of the STEM ecosystem. A broad and representative cross-section of community stakeholders will design and develop evidence-based STEM ecosystem organizing and implementation strategies. Key outcomes anticipated from this project are the development of a shared understanding, agenda, activities, and commitment to collectively address the underlying challenges of STEM access and participation for African American youth. The goal of this community-driven project is to develop a viable system model that elevates neighborhood voices, historically excluded from the problem-solving table and decision-making processes, to leverage existing assets, build local capacity, increase messaging and awareness of the value of STEM, identify needed new programs, and develop coordination/resource sharing mechanisms across partners to support implementation. The evaluation of this project will be grounded in systems thinking and culturally-responsive approaches that seek to understand the diverse perspectives of stakeholders while measuring progress toward project goals. Evaluation data will be used to assess the problem structuring process, to evaluate the organizational strategy designed to address the structured problem, and to support adaptive learning among stakeholders.
This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie
Increasingly, the prosperity, innovation and security of individuals and communities depend on a big data literate society. Yet conspicuously absent from the big data revolution is the field of teaching and learning. The revolution in big data must match a complementary revolution in a new kind of literacy, through a significant infusion of STEM education with the kinds of skills that the revolution in 21st century data-driven science demands. This project represents a concerted effort to determine what it means to be a big data literate citizen, information worker, researcher, or policymaker; to identify the quality of learning resources and programs to improve big data literacy; and to chart a path forward that will bridge big data practice with big data learning, education and career readiness.
Through a process of inquiry research and capacity-building, New York Hall of Science will bring together experts from member institutions of the Northeast Big Data Innovation Hub to galvanize big data communities of practice around education, identify and articulate the nature and quality of extant big data education resources and draft a set of big data literacy principles. The results of this planning process will be a planning document for a Big Data Literacy Spoke that will form an initiative to develop frameworks, strategies and scope and sequence to advance lifelong big data literacy for grades P-20 and across learning settings; and devise, implement, and evaluate programs, curricula and interventions to improve big data literacy for all. The planning document will articulate the findings of the inquiry research and evaluation to provide a practical tool to inform and cultivate other initiatives in data literacy both within the Northeast Big Data Innovation Hub and beyond.
As part of a grant from the National Science Foundation, the National Federation of the Blind (NFB) is conducting regional STEM workshops in partnership with local science museums, entitled NFB STEM2U, for blind youth [youth], grades 3 – 6 and 9-12 [mentors]. During the fourth regional workshop in Phoenix, AZ, the NFB operated three different programs simultaneously: one program for youth, a second program for their parents/caregivers, and a third program for teachers of the visually impaired. A fourth program, for Arizona Science Center staff, was conducted earlier to prepare the museum staff
The Center for Children and Technology (CCT) at Education Development Center, Inc., an international nonprofit research and development organization (cct.edc.org), conducted the formative evaluation of the fourth year of the Be A Scientist! (BAS) project. This project, managed by Iridescent—a nonprofit afterschool science, technology, engineering, and mathematics (STEM) program (www.iridescentlearning.org), has the goal of providing high-quality afterschool science and engineering courses to underserved families in New York City and Los Angeles. The project aims to enable participants to
The National Writing Project (NWP) is collaborating with the Association of Science-Technology Centers (ASTC) on a four-year, full-scale development project that is designed to integrate science and literacy. Partnerships will be formed between NWP sites and ASTC member science centers and museums to develop, test, and refine innovative programs for educators and youth, resulting in the creation of a unique learning network. The project highlights the critical need for the integration of science and literacy and builds on recommendations in the Common Core State Standards and the National Research Council's publication, "A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas." The content focus includes current topics in science and technology such as environmental science, sustainability, synthetic biology, geoengineering, and other subjects which align with science center research and exhibits. The project design is supported by a framework that incorporates a constructivist/inquiry-based approach that capitalizes on the synergy between rigorous science learning and robust literacy practices. Project deliverables include a set of 10 local partnership sites, professional development for network members, a project website, and an evaluation report highlighting lessons learned. Partnership sites will be selected based on interest, proximity, history, and expertise. Two geographically and demographically diverse cohorts, consisting of five partnerships each will be identified in Years 2 and 3. Each set of partners will be charged with creating a comprehensive two-year plan for science literacy activities and products to be implemented at local sites. It is anticipated that the pilot programs may result in the creation of new programs that merge science and writing, integrate writing into existing museum science programs, or integrate science activities into existing NWP programs. Interest-driven youth projects such as citizen science and science journalism activities are examples of programmatic approaches that may be adopted. The partners will convene periodically for planning and professional development focused on the integration of science and literacy for public and professional audiences, provided in part by national practitioners and research experts. A network Design Team that includes leadership representatives from NWP, ASTC, and the project evaluator, Inverness Research, Inc., will oversee project efforts in conjunction with a national advisory board, while a Partnership Coordinator will provide support for the local sites. Inverness Research will conduct a multi-level evaluation to address the following questions: -What is the nature and quality of the local partner arrangements, and the larger network as a whole? -What is the nature and quality of the local science literacy programs that local partners initiate, and how do they engage local participants, and develop their sense of inquiry and communication skills? First, a Designed-Based Implementation Research approach will be used for the developmental evaluation to assess the implementation process. Next, the documentation and portrayal phase will assess the benefits to youth, educators, institutions, and the field using surveys, interviews, observations of educators, and reviews of science communication efforts created by youth. Finally, the summative evaluation includes a comprehensive portfolio of evidence to document the audience impacts and an independent assessment of the project model by an Evaluation Review Board. This project will result in the creation of a robust learning community while contributing knowledge and lessons learned to the field about networks and innovative partnerships. It is anticipated that formal and informal educators will gain increased knowledge about science and literacy programs and develop skills to provide effective programs, while youth will demonstrate increased understanding of key science concepts and the ability to communicate science. Programs created by the local partnerships will serve approximately 650 educators (450 informal educators and 200 K-12 teachers) and 500 youth ages 9-18. Plans for dissemination, expansion, and sustainability will be undertaken by the sub-networks of the collaborating national organizations drawing on the 350 ASTC member institutions and nearly 200 NWP sites at colleges and universities.
This full-scale development project will address the need for creative models to support STEM learning in underserved rural communities that lack traditional infrastructure such as science centers. The project will create and study an innovative model of capacity-building: viz., small networks of community-embedded “STEM Guides” will be trained to identify a range of existing STEM resources available in their local regions, and to connect STEM-interested youth with them in creative and personal ways. Anticipated learning outcomes for youth and families include greater awareness of and interest in STEM experiences and pathways. At the regional level, the project will build capacity through increasing the STEM Guides’ knowledge of local STEM opportunities, and by enhancing connections among STEM-related resources, programs, and industries. The project will implement and study STEM Guide networks in a staggered series of five low-income, rural regions, providing startup resources and professional development. The project will increase the frequency and depth of out-of-school STEM experiences for approximately 3,000 youth aged 10-18 at a relatively low cost, creating a national model for STEM capacity-building in rural settings. It is led by the Maine Mathematics and Science Alliance, with 4-H, Cornerstones of Science (library-based STEM) and Maine’s university system as collaborators. EDC is the primary external evaluator.
The Global Soundscapes! Big Data, Big Screens, Open Ears Project uses the new science of soundscape ecology to design a variety of informal science learning experiences that engage participants through acoustic discovery Soundscape ecology is an interdisciplinary science that studies how humans relate to place through sound and how humans influence the environment through the alteration of natural sound composition. The project includes: (1) an interface to the NSF-funded Global Sustainable Soundscapes Network, which includes 12 universities around the world; (2) sound-based learning experiences targeting middle-school students (grades 5-8), visually impaired and urban students, and the general public; and (3) professional development for informal science educators. Project educational components include: the first interactive, sound-based digital theater experience; hands-on Your Ecosystem Listening Labs (YELLS), a 1-2 day program for school classes and out-of school groups; a soundscape database that will assist researchers in developing a soundscape Big Database; and iListen, a virtual online portal for learning and discovery about soundscape. The project team includes Purdue-based researchers involved in soundscape and other ecological research; Foxfire Interactive, an award-winning educational media company; science museum partners with digital theaters; the National Audubon Society and its national network of field stations; the Perkins School for the Blind; and Multimedia Research (as the external evaluator).
The intent of this project is to use social network methods to study networks of afterschool and informal science stakeholders. It would attempt to create knowledge that improves afterschool programs access to informal science learning materials. This is an applied research study that applies research methods to improving access to and enactment of informal science education programs across a range of settings. The investigators plan to collect data from 600 community- and afterschool programs in California, conduct case studies of 10 of these programs, and conduct surveys of supporting intermediary organizations. The analysis of the data will provide descriptions of the duration, intensity, and nature of the networks among afterschool programs and intermediary agencies, and the diffusion patterns of science learning materials in afterschool programs. The project will yield actionable knowledge that will be disseminated among afterschool programs, intermediary organizations, funding agencies, and policymakers to improve the dissemination and support of afterschool science learning opportunities. The project is focused on free-choice settings where every day the largest numbers of children attend afterschool programs at schools and in other community settings. It seeks information about what conditions are necessary for informal science programs to significantly impact the largest possible number of children in these settings.
DATE:
-
TEAM MEMBERS:
Barbara MeansAnn HouseCarlin LlorenteRaymond McGhee
The objective of this project is to provide a complete package of KIDSPACE hands-on science experiences to small and developing science centers across the country through the National KIDSPACE Partnership Program. This project will allow twelve (12) selected science centers to implement a complete, proven education package geared toward young children at a fraction of the cost of starting one from scratch. This project will provide comprehensive training to a large core of educators within the science center field, and will support continued research into the informal science education of young children through an original Research Study and the formation of a national User's Group. Best of all, this project will generate a wellspring of invaluable science-play connections for hundreds of thousands of children to tale with them into adulthood.