In fall 2019, the Bell Museum received funding via a NASA TEAM II grant to create Mars: The Ultimate Voyage, a full-dome planetarium show and accompanying hands-on activities that focus on the interdisciplinary roles that will be needed to send humans to Mars. This report from Catalyst Consulting Group presents the findings from the summative evaluation completed in March–May 2023.
The Dunes Center will provide in-class instruction and field trip activities focused on coastal restoration and community education on water quality for over 300 5th-graders at Guadalupe’s Kermit McKenzie Intermediate School. Through science experiments and hands-on experiences, students will learn how ecosystems function and explore watershed characteristics. Intended to supplement current local science education and reach underserved, rural, Latinx students, the “Explore the Coast” program will help students understand how human actions can affect the environment, promote pollution prevention in the community, and aspire to higher education in the field of science.
This project will examine the characteristics and outcomes of a large sample of environmental education field trip programs for youth to elucidate program characteristics that most powerfully influence 21st century learning outcomes. Environmental education programs for youth, particularly day-long school trip programs, are popular and reside at the intersection of formal and informal STEM education. Such field trips provide opportunities for diverse audiences to participate in shared learning experiences, but current understanding of what leads to success in these programs is limited. This large-scale study will address this gap in knowledge by investigating the linkages between program characteristics and participant outcomes for at least 800 single-day environmental education field trip programs for youth in grades 5-8, particularly programs for diverse and underserved audiences. This study will result in the identification of evidence-based practices that will inform future program design for a wide variety of settings, including nature centers, national parks, zoos, museums, aquaria, and other locations providing informal environmental education programs.
This Research in Service to Practice study is guided by two research questions: 1) What program characteristics (context, design, and delivery) most powerfully influence learner self-determination and learner outcomes? And 2) Do the most influential program characteristics differ across diverse and underserved audiences (e.g. African American, Hispanic/Latino, economically disadvantaged) and contexts (e.g. rural versus urban)? This project will examine a wide range of program-related factors, including pedagogical approaches and contextual characteristics. A valid and reliable protocol for observing 78 program characteristics hypothesized to influence learner outcomes developed by a previous project will be used to systematically sample and observe 500 single-day environmental education field trip programs for youth in grades 5-8 distributed across at least 40 U.S. states and territories. Programs for diverse and underserved youth will be emphasized, and a diverse set of programs in terms of program type and context will be sought. Data from this sample will be combined with those of an existing sample of 334 programs provided by over 90 providers. The final combined sample of over 800 programs will provide sufficient statistical power to confidently identify which program components are most consistently linked with learning outcomes. This sample size will also enable stratification of the sample for examination of these relationships within relevant subpopulations. Principal component analyses will be used to reduce data in theoretically meaningful and statistically valid ways, and multilevel structural equation modeling will be employed to examine the influences of both participants' individual characteristics and program and context characteristics on participant outcomes. Since one research question focuses on whether program outcomes are the same across different audiences, the project will include at least 200 programs for each of three specific audiences to ensure sufficient statistical power for confidence in the results: primarily African American, primarily Hispanic/Latino, and primarily White.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert PowellMarc SternBrandon Frensley
Concord Evaluation Group (CEG) conducted an outreach partner evaluation for Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie
Abstract: We aim to disrupt the multigenerational cycle of poverty in our rural indigenous (18% Native American and 82% Hispanic) community by training our successful college students to serve as role models in our schools. Poverty has led to low educational aspirations and expectations that plague our entire community. As such, its disruption requires a collective effort from our entire community. Our Collective unites two local public colleges, 3 school systems, 2 libraries, 1 museum, 1 national laboratory and four local organizations devoted to youth development. Together we will focus on raising aspirations and expectations in STEM (Science, Technology, Engineering and Mathematics) topics, for STEM deficiencies among 9th graders place them at risk of dropping out while STEM deficiencies among 11th and 12th graders preclude them from pursuing STEM majors in college and therefore from pursuing well paid STEM careers. We will accomplish this by training, placing, supporting, and assessing the impact of, an indigenous STEM mentor corps of successful undergraduate role models. By changing STEM aspirations and expectations while heightening their own sense of self-efficacy, we expect this corps to replenish itself and so permanently increase the flow of the state's indigenous populations into STEM majors and careers in line with NSF's mission to promote the progress of science while advancing the national health, prosperity and welfare.
Our broader goal is to focus the talents and energies of a diverse collective of community stakeholders on the empowerment of its local college population to address and solve a STEM disparity that bears directly on the community's well-being in a fashion that is generalizable to other marginalized communities. The scope of our project is defined by six tightly coupled new programs: three bringing indigenous STEM mentors to students, one training mentors, one training mentees to value and grow their network of mentors, and one training teachers to partner with us in STEM. The intellectual merit of our project lies not only in its assertion that authentic STEM mentors will exert an outsize influence in their communities while increasing their own sense of self-efficacy, but in the creation and careful application of instruments that assess the factors that determine teens' attitudes, career interests, and behaviors toward a STEM future; and mentors' sense of self development and progress through STEM programs. More precisely, evaluation of the programs has the potential to clarify two important questions about the role of college-age mentors in schools: (1) To what degree is the protege's academic performance and perceived scholastic competence mediated by the mentor's impact on (a) the quality of the protege's parental relationship and (b) the social capital of the allied classroom teacher; (2) To what degree does the quality of the student mentor's relationships with faculty and peers mediate the impact of her serving as mentor on her self-efficacy, academic performance, and leadership skills?
Deals with the success of the Rural Girls in Science Program at the University of Washington in Seattle, Washington State, which uses science to address local issues through long-term research projects. Source of funding for the program; Components of the research projects; Factors which contributed to the success of the program.
DATE:
TEAM MEMBERS:
Angela GinorioJanice FournierKatie Frevert