Summative evaluation of the Marcellus Matters: EASE project. Marcellus Matters: Engaging Adults in Science and Energy (EASE) was a program of Penn State University’s Marcellus Center for Outreach and Research (MCOR), in collaboration with other experts across the university. The first year of program activities took place in 2012, and the project continued through September 2016. EASE was a multidisciplinary initiative that provided adults in rural Pennsylvania with opportunities to increase their knowledge of science and energy systems and engage in scientific inquiry and investigation
Background: Some STEM outreach programs connect students to real-world problems and challenge them to work towards solutions. Research shows one-third of children between ages 5-17 in the U.S. are overweight. Socioeconomic status, race, and parental educational attainment all influence this issue as well as living in a rural or urban area. A rural high school STEM outreach program used a social media curriculum focused on healthy lifestyles and measured impact on the health of adolescents from these backgrounds.
Methods: Health screenings and college mentors were provided to 134
DATE:
TEAM MEMBERS:
Ann ChesterSara HanksSummer KuhnFloyd JonesTravis WhiteMisty HarrisBethany Hornbeck Sherron McKendallMary McMillionCathy MortonMallory SlusserR. Kyle Saunders
The concept of connected learning proposes that youth leverage individual interest and social media to drive learning with an academic focus. To illustrate, we present in-depth case studies of Ryan and Sam, two middle-school-age youth, to document an out-of-school intervention intended to direct toward intentional learning in STEM that taps interest and motivation. The investigation focused on how Ryan and Sam interacted with the designed elements of Studio STEM and whether they became more engaged to gain deeper learning about science concepts related to energy sustainability. The
Concord Evaluation Group (CEG) conducted an outreach partner evaluation for Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
In 2017, Concord Evaluation Group (CEG) conducted a summative evaluation of Design Squad Global (DSG). DSG is produced and managed by WGBH Educational Foundation. WGBH partnered with FHI 360, a nonprofit human development organizations working in 70 countries, to implement DSG around the globe.
In the DSG program, children in afterschool and school clubs explored engineering through hands-on activities, such as designing and building an emergency shelter or a structure that could withstand an earthquake. Through DSG, children also had the chance to work alongside a partner club from another
Hubbard Brook Roundtables are a method of face-to-face PES developed by science communication practitioners at a long-term ecological research site in New Hampshire’s White Mountains. Hubbard Brook Roundtables use facilitated dialogue with stakeholders and ecologists to harness the power of “ecosystem thinking” to address complex socioscientific questions. Here we present key lessons from more than ten years of convening roundtables in the Northern Forest region of the northeastern US.
Improving retention rates in postsecondary engineering degree programs is the single most effective approach for addressing the national shortage of skilled engineers. Both mathematics course placement and performance are strong graduation predictors in engineering, even after controlling for demographic characteristics. Underrepresented students (e.g., rural students, low-income students, first-generation students, and students of color) are disproportionately represented in cohorts that enter engineering programs not yet calculus-ready. Frequently, the time and cost of obtaining an engineering degree is increased, and the likelihood of obtaining the degree is also reduced. This educational problem is particularly acute for African American students who attended select high schools in South Carolina, with extremely high-poverty rates. As a result, the investigators proposed an NSF INCLUDES Launch Pilot project to develop a statewide consortium in South Carolina - comprising all of the public four-year institutions with ABET-approved engineering degree programs, all of the technical colleges, and 118 high schools with 70% or higher poverty rates, to pinpoint and address the barriers that prevent these students from being calculus ready in engineering.
This NSF INCLUDES Launch Pilot project will map completion/attrition pathways of students by collecting robust cross-sectional data to identify and understand the complex linkages between and behind critical decisions. Such data have not been available to this extent, especially focused on diverse populations. Further, by developing structural equation models (SEMs), the investigators will be able to build on extant research, contributing directly to understanding the relative impact of a range of latent variables on the development of engineering identity, particularly among African American, rural, low-income, and first-generation engineering students. Results of the pilot interventions are likely to contribute to the empirical and theoretical literature that focus on engineering persistence among underrepresented populations. Project plans also include developing a centralized database compatible to the Multiple Institution Database for Investigation of Engineering Longitudinal Development (MIDFIELD) project to share institutional data with K-12 and postsecondary administrators, engineering educators, and education researchers with NSF INCLUDES projects and beyond.
DATE:
-
TEAM MEMBERS:
Anand GramopadhyeDerek BrownEliza GallagherKristin Frady
RMC Research designed evaluation activities to provide formative and summative feedback to the Hubbard Brook Research Foundation (HBRF) on their NSF Pathways project, Forest Science Dialogues (FSD). FSD consists of a plan to engage with scientists at the Hubbard Brook Ecosystem Study and with the surrounding community using the Hubbard Brook Roundtable dialogue process in order to facilitate mutual learning. The purpose of this engagement was to increase public knowledge, understanding, and awareness of ecosystem science in the Northern Forest in order to enrich local dialogue surrounding
Aligning for Impact: Computer Science Pathways Across Contexts [CS-PAC] is an NSF INCLUDES Design and Development Launch Pilot. It broadens participation of students who are underrepresented in computer science by using the convening and policy-making power of the Georgia State Department of Education to coalesce school district leaders to implement K-12 computer science education. The project provides a national model for how to work toward systemic change. With the State Department of Education's coordination, several school districts will collaboratively seek improvements in their own student participation rates. The coordination of data reporting and analysis, resources, communications, and policy promote more equitable participation in computer science education. Research emerging from this project informs other states about how to collaboratively shape computer science education policy and policy implementation.
Using a Collective Impact approach to systemic change, the project creates sustainable institutional change at the community, state, and national levels. Qualitative and quantitative data provide descriptions about how to utilize alignment strategies within Collective Impact in three different contexts: rural, suburban, and urban. Outcomes utilize a regression discontinuity analysis to justify successful implementation as well as qualitative analysis of implementation efforts that were deemed most effective by all stakeholders. The project outputs directly affect over 88,000 students across five districts and indirectly affect over 1.7 million in Georgia alone. The culminating project goal is the development of a coherent framework for aligning K-12 computer science education pathways.
DATE:
-
TEAM MEMBERS:
Caitlin DooleyBryan CoxShawn Utley
resourceprojectProfessional Development and Workshops
This is an "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot that will implement a plan to assess the feasibility of a strategy designed to ensure high levels of improvement in K-12 grade students' mathematics achievement. The plan will focus on an often-neglected group of students--those who have been performing at the lowest quartile on state tests of mathematics, including African American, Hispanic, Native American, students with disabilities, and those segregated in urban and rural communities across the country. The project will draw on lessons learned from the nation's Civil Rights Movement and a community-organizing strategy learned during the struggle to achieve voting rights for African Americans. The Algebra Project (AP) is a national, nonprofit organization that uses mathematics as an organizing tool to ensure quality public school education for every child in America; it believes that every child has a right to a quality education to succeed in this technology-based society. AP's unique approach to school reform intentionally develops sustainable, student-centered models by building coalitions of stakeholders within the local communities, particularly the historically underserved populations. The AP works to change the deeply rooted social attitudes that encourage the disenfranchisement of a third of the nation's population. It delivers a multi-pronged approach to build demand for and support of quality public schools, including research and development, school development, and community development education reform efforts through K-12 initiatives.
The Algebra Project and the Young People's Project (YPP) will join efforts to bring together over 70 individuals and organizations, including 17 universities of which 8 are Historical Black Colleges and Universities, school districts, mathematics educators, and researchers to examine their experiences, and use collective learning to refine and hone strategies that they have piloted and tested to promote mathematics inclusion. The role of YPP in the proposed project will be to organize and facilitate the youth component, such that project activities reflect the language and culture of students, continuously leveraging and building upon their voice, creative input, and ongoing feedback. YPP will conduct workshops for students organized around math-based games that provide collective experiences in which student learning requires individual reflection, small group work, teamwork and discussion. The proposed work will comprise the design of effective learning opportunities; building and supporting a cadre of teachers who can effectively work with students learning under the proposed approach; using technologies to enhance teaching and learning; and utilizing evaluation and research to drive continuous improvement. Because bringing together an effective network with diverse expertise to collaborate towards national impact requires expert facilitation processes, the project will establish working groups around three major principles: (1) Organizing from the bottom up through students, their teachers, and others in local communities committed to their education, allied with individuals and organizations who have expertise and dedication for achieving the stated goals, can produce significant progress and the conditions for collective impact; (2) Effective learning materials and formal and informal learning opportunities in mathematics can be designed and implemented for students performing in the bottom academic quartile; and (3) Teachers and other educators can become more proficient and more confident in their capacity to produce students who are successful in learning the level of mathematics required for full participation in STEM. The working groups will also be tasked to consider two cross-cutting topics: (a) the communication structures and technologies needed to operate and expand the present network, and to create the "backbone" and other structures needed to operate and expand the network; and (b) the measurements and metrics for major needs, such as assessing students' mathematics literacy, socio-emotional development in specified areas; teachers' competencies; as well as the work of the network. The final product of this plan will be a "Theory of Collective Action and Strategic Plan". The plan will contain recommendations for collective actions needed in order for the current network to coordinate, add appropriate partners, develop the needed backbone structures, and become an NSF Alliance for national impact on the broadening participation challenge of improving the mathematics achievement. An external evaluator will conduct both formative and summative aspects of this process.
DATE:
-
TEAM MEMBERS:
Robert MosesNell CobbGregory BudzbanMaisha MosesWilliam Crombie
Community colleges play a vital role in educating undergraduate students. These higher education institutions educate nearly half of the nation's undergraduate students, particularly among low-income and first-generation students and students of color. Because of the rich diversity that currently exists at these institutional-types, there are immense opportunities to broadening participation throughout the engineering enterprise. To this end, the investigator outlines a joint collaboration with five community colleges, three school systems, two college career academies, and a state partner in Georgia - referred as the Georgia Science, Technology, and Engineering Partnerships for Success (GA STEPS) - to provide dual enrollment classes in career pathways for Georgia high school students in grades 9-12, thereby allowing secondary students to earn college credit. The Georgia STEPS program proposes to leverage mechatronics engineering as a means for broadening engineering participation for community colleges and underserved, underrepresented populations in 48 rural counties to increase engineering awareness, skills training and college and career readiness. The project builds on an existing collaboration that has developed successful engineering opportunities at the community college level, by including a wider regional network of rural Georgia counties and high schools. Further, this project has immense potential to transform engineering education and course-taking for students at the secondary and postsecondary level in Georgia and beyond. It has potential great potential to be scaled and replicated at other placed around the United States.
The project's intellectual merit and innovation is that it leverages a successful mechatronics engineering curriculum that supports engineering skills that support local industry as well as supporting innovations in the mechatronics field. The project includes a collective impact framework, involving various stakeholders and aligning quantitative and qualitative metrics and measurable objectives. The broader impacts of this project is that it increases the engineering knowledge and skills of underserved, underrepresented students that are enrolled in community colleges. Also, the impact to rural communities in Georgia support the fact that this project would meet broader groups that can be positively impacted by this type of collaborative. The ability to provide different parts of this engineering discipline across broad audiences in community colleges - that support underrepresented groups understanding of mechatronics engineering - is broadly useful to the field of engineering.
Dr. Ann Chester, Director of the Health Sciences and Technology Academy (HSTA) in West Virginia was looking for professional researchers interested in working with HSTA's high school-aged participants through community-based participatory research (CBPR) projects. Dr. Alicia Zbehlik, with the Dartmouth Institute for Health Policy & Clinical Practice in New Hampshire, needed to further her research in knee osteoarthritis to support a pilot intervention in her target population. The two met, saw potential benefits to both organizations in forming a partnership, and agreed to undertake a one-year
DATE:
TEAM MEMBERS:
Paul Luis SicilianoBethany L. HornbeckSara HanksSummer L. KuhnAlicia J. ZbehlikAnn L. Chester