The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
In The Nature of Community: SCIENCES, we share the lessons learned from an innovative partnership designed to leverage the strengths of two nonprofit organizations—a large cultural institution and a smaller, deeply-rooted community-based organization, both of which offer informal science education expertise.
You’ll read first-hand reflections of how staff members, community leaders and members, children, and adults experienced this partnership: the expectations, surprises, challenges, successes, and lessons learned. We hope the description of this partnership inspires other organizations to
The independent evaluation firm, Knight Williams, Inc., developed a two-part post-program survey to gather information about the Year 1 SciGirls CONNECT2 outreach programs conducted by 14 partner organizations. The evaluation aimed for one educator from each organization to complete Part 1 of the survey, which consisted of program reporting questions. In all, one educator from 13 partner organizations completed Part 1, for a response rate of 93%. Part 2 of the survey asked for program reflections, with a focus on perceived program goals, impacts, highlights, and challenges. Given the
The independent evaluation firm Knight Williams, Inc. conducted a formative evaluation during Year 2 of the SciGirls CONNECT2 program in order to gather information about the partner educators’ use of, reflections on, and recommendations relating to the draft updated SciGirls Strategies. The evaluation aimed for two educators from each of 14 partner organizations – specifically the program leader and one educator who was familiar with the original SciGirls Seven – to provide reflections on their use of the draft SciGirls Strategies in their programs through an online survey and follow-up
The independent evaluators at Knight Williams Inc. developed a front-end survey to gather background and baseline information about the 16 partner organizations selected to conduct outreach programs as part of SciGirls CONNECT2. The goal was for two people from each partner organization to complete the online survey about their background and prior use of the SciGirls Seven and related strategies. A total of 30 partner representatives completed the survey by the requested deadline, resulting in a response rate of 94%. The majority identified as program leaders, with smaller groups saying they
This zine summarizes the book "Equity, Exclusion and Everyday Science Learning." It provides an accessible graphic introduction to how inequalities in everyday science learning happen, so that we can get to a place where everyday science learning practices could disrupt and transform social inequities rather than reproducing them.
The employment demands in STEM fields grew twice as fast as employment in non-STEM fields in the last decade, making it a matter of national importance to educate the next generation about science, engineering and the scientific process. The need to educate students about STEM is particularly pronounced in low-income, rural communities where: i) students may perceive that STEM learning has little relevance to their lives; ii) there are little, if any, STEM-related resources and infrastructure available at their schools or in their immediate areas; and iii) STEM teachers, usually one per school, often teach out of their area expertise, and lack a network from which they can learn and with which they can share experiences. Through the proposed project, middle school teachers in low-income, rural communities will partner with Dartmouth faculty and graduate students and professional science educators at the Montshire Museum of Science to develop sustainable STEM curricular units for their schools. These crosscutting units will include a series of hands-on, investigative, active learning, and standards-aligned lessons based in part on engineering design principles that may be used annually for the betterment of student learning. Once developed and tested in a classroom setting in our four pilot schools, the units will be made available to other partner schools in NH and VT and finally to any school wishing to adopt them. In addition, A STEM rural educator network, through which crosscutting units may be disseminated and teachers may share and support each other, will be created to enhance the teachers’ ability to network, seek advice, share information, etc.
This application requests support to enable a team of experienced science educators and biomedical and behavioral health network scientists to develop and implement the Worlds of Connections curriculum. Most middle school students are familiar with patient care-related health careers (e.g., nurses, dentists, surgeons), but few know about emerging careers in network science that can be leveraged to improve population health. This innovative and research-based science program is strategically designed to increase awareness of, understanding of, and interest in the important role of network science for health. This project will design learning activities that incite interest in network science applications to biomedical and public health research. The long- term goal is to enhance the diversity of the bio-behavioral and biomedical workforce by increasing interest in network science among members of underrepresented minority communities and to promote public understanding of the benefits of NIH-funded research for public health. The goal of this application is to identify and create resources that will overcome barriers to network science uptake among underserved minority middle school youth. The central hypothesis is that the technology-rich field of network science will attract segments of today’s youth who remain uninterested in conventional, bio-centric health fields. Project activities are designed to improve understanding of how informal STEM experiences with network science in health research can increase STEM identities, STEM possible selves, and STEM career aspirations among youth from groups historically underrepresented in STEM disciplines at the center of health science research (Aim 1) and create emerging media resources via augmented reality technologies to stimulate broad interest in and understanding of the role of network science in biomedical and public health research (Aim 2). A team led by University of Nebraska-Lincoln sociologists will partner with the University of Nebraska at Omaha; state museums; centers for math, science, and emerging media arts; NIH-funded network scientists; educators; community learning centers at local public schools; learning researchers; undergraduates; software professionals; artists; augmented reality professionals; storytellers; and evaluation experts to accomplish these goals and ensure out of school learning will reinforce Next Generation Science Standards. The Worlds of Connections project is expected to impact 35,250 youth and 20,570 educators in Lincoln and Omaha, Nebraska by: adding network science modules to ongoing 6th-8th-grade afterschool STEM clubs in community learning centers; adding network science for health resources to a summer graduate course on “activating youth STEM identities” for sixth to twelfth grade STEM teachers; connecting teachers with local network scientists; creating free, downloadable, high-quality emerging media arts-enhanced stories; and publishing peer-reviewed research on the potential of network science to attract youth to health careers. Coupled with the dissemination plan, the project design and activities will be replicable, allowing this project to serve as a model to guide other projects in STEM communication.
PUBLIC HEALTH RELEVANCE:
The lack of public understanding about the role of network science in the basic biological and social health sciences limits career options and support for historically underrepresented groups whose diverse viewpoints and questions will be needed to solve the next generation of health problems. The Worlds of Connections project will combine network science, social science, learning research, biology, computer science, mathematics, emerging media arts, and informal science learning expertise to build a series of monitored and evaluated dissemination experiments for middle school science education in high poverty schools. Broad dissemination of the curriculum and project impacts will employ virtual reality technologies to bring new and younger publics into health-related STEM careers.
A report following the 2016 Environmental Health Summit recommended engaging citizens in creating their own knowledge and solutions, thus ensuring that their concerns are adequately addressed and promoting sustainability of community projects. Indeed, citizen science has the potential to initiate a cascade of events with a positive ripple effect that includes a more diverse future STEM and biomedical workforce. This SEPA proposal involves the establishment of WE ENGAGE – an informal, citizen science-based, environmental health experiential learning program designed in partnership with and for under resourced communities struggling with health and environmental health challenges. Its purpose is to actively engage and build the citizen science capacity of citizens living in a single cluster of three contiguous under resourced, minority Cincinnati neighborhoods where generational challenges continue to plague residents despite the presence of established academic-community partnerships. Our hypothesis is that community-informed, experiential learning opportunities outside of the classroom that are structured, multi-generational, and story-based will encourage a) the active asking, discussion about, and answering of relevant complex health and environmental questions so that individuals and communities can plan action steps to make better health choices and pursue healthier environments, and b) greater interest and confidence in pursuing formal biomedical/STEM education and STEM careers. Our program has three specific aims: 1) We will co-create tailored story- based (graphic novel style) STEM education materials with a community advisory board and offer informal STEM education and research training to our target communities; 2) we will facilitate the application of scientific inquiry skills to improve health via community-led health fairs that use an innovative electronic health passport platform to collect data and through facilitated community discussions of health fair data to generate motivating stories to share; and 3) we will facilitate the application of scientific inquiry skills to foster community pride and activism in promoting healthier/safer built environments via walking environmental assessments. As in aim 2, facilitated discussions will be held to spur future community based participatory research studies and interventions. Critical to our success is the concept of storytelling. Storytelling is a foundation of the human experience. A key purpose of storytelling is not just understanding the world, but positively transforming it. It is a common language. Bringing together STEM concepts in the form of a story increases their appeal and meaning. Later, the very process of community data collection gives individuals a voice. In a data story, hundreds to millions of voices can be distilled into a single narrative that can help community members probe important underlying associations and get to the root causes of complicated health issues relevant to their communities. Through place based, understandable, motivating data stories, the community’s collective voice is clearer—leading to relevant and viable actions that can be decided and taken together. From preventing chronic disease, to nurturing healthier environments, to encouraging STEM education — stories have unlimited potential.
Public Health Relevance Statement:
Narrative WE ENGAGE is an informal citizen science-based, experiential learning program designed in partnership with and for middle schoolers to adults living in under resourced minority communities. Using the power of data collection and storytelling, its purpose is to actively engage citizens in STEM/research education and training to encourage a more diverse future workforce and to sustainably build local capacity to ask and answer complex health and environmental questions relevant to their communities. Further, by engaging citizens and giving them a more equitable stake in the research process, they are better able to discover their own solutions.
DATE:
-
TEAM MEMBERS:
Melinda Sue ButschkovacicSusan Ann Hershberger
This project specifically addresses the SMRB’s imperative that “NIH’s pre-college STEM activities need a rejuvenated integrated focus on biomedical workforce preparedness with special considerations for under-represented minorities.”
Approximately one-third of CityLab’s participants are under-represented minority (URM) students, but we now have a unique opportunity to build a program that will reach many URM students and position them for undergraduate STEM success. We have partnered with urban squash education organizations in Boston (SquashBusters) and New York (CitySquash and StreetSquash) that recruit URM/low SES students to participate in after-school squash training and academic enrichment programs. We have also partnered with the Squash + Education Alliance (previously named the National Urban Squash and Education Association) to disseminate the new program—first from Boston to New York and later through its national network of affiliated squash education programs.
In order to bring this project to fruition, Boston University is joining forces with Fordham University in New York. Fordham is home to CitySquash so these organizations provide an ideal base for the New York activities. The proposed project will enable us to demonstrate feasibility and replicability within the 5-year scope of this grant. Our shared vision is to develop a national model for informal precollege biomedical science education that can be infused into a myriad of similar athletic/academic enrichment programs.
The squash education movement for urban youth has been highly successful in enrolling program graduates in college. Since the academic offerings of the squash education programs focus on English Language Arts and Mathematics, their students struggle with science and rarely recognize the tremendous opportunities for long- term employment in STEM fields.
This project will bring CityLab’s resources to local squash programs in a coordinated and sustained engagement to introduce students to STEM, specifically the biomedical sciences. Together with the urban squash centers, we will build upon the hands-on life science experiences developed and widely disseminated by CityLab to create engaging laboratory-based experiences involving athletics and physiology.
The specific aims of the proposed project are:
To develop, implement, and evaluate a new partnership model for recruiting URM/low SES students and inspiring them to pursue careers in STEM; and
To examine changes in the science learner identities (SLI) of the students who participate in this program and establish this metric as a marker for continued engagement in STEM.
With the involvement of the two urban research universities, three local squash education programs, and SEA, we see this new SEPA initiative as a unique way to pilot, refine, and disseminate an after-school/informal science education program that can have a significant impact on the nation’s production of talented STEM graduates from URM/low SES backgrounds.
DATE:
-
TEAM MEMBERS:
Carl FranzblauDonald DeRosaCarla Romney
This project will examine the characteristics and outcomes of a large sample of environmental education field trip programs for youth to elucidate program characteristics that most powerfully influence 21st century learning outcomes. Environmental education programs for youth, particularly day-long school trip programs, are popular and reside at the intersection of formal and informal STEM education. Such field trips provide opportunities for diverse audiences to participate in shared learning experiences, but current understanding of what leads to success in these programs is limited. This large-scale study will address this gap in knowledge by investigating the linkages between program characteristics and participant outcomes for at least 800 single-day environmental education field trip programs for youth in grades 5-8, particularly programs for diverse and underserved audiences. This study will result in the identification of evidence-based practices that will inform future program design for a wide variety of settings, including nature centers, national parks, zoos, museums, aquaria, and other locations providing informal environmental education programs.
This Research in Service to Practice study is guided by two research questions: 1) What program characteristics (context, design, and delivery) most powerfully influence learner self-determination and learner outcomes? And 2) Do the most influential program characteristics differ across diverse and underserved audiences (e.g. African American, Hispanic/Latino, economically disadvantaged) and contexts (e.g. rural versus urban)? This project will examine a wide range of program-related factors, including pedagogical approaches and contextual characteristics. A valid and reliable protocol for observing 78 program characteristics hypothesized to influence learner outcomes developed by a previous project will be used to systematically sample and observe 500 single-day environmental education field trip programs for youth in grades 5-8 distributed across at least 40 U.S. states and territories. Programs for diverse and underserved youth will be emphasized, and a diverse set of programs in terms of program type and context will be sought. Data from this sample will be combined with those of an existing sample of 334 programs provided by over 90 providers. The final combined sample of over 800 programs will provide sufficient statistical power to confidently identify which program components are most consistently linked with learning outcomes. This sample size will also enable stratification of the sample for examination of these relationships within relevant subpopulations. Principal component analyses will be used to reduce data in theoretically meaningful and statistically valid ways, and multilevel structural equation modeling will be employed to examine the influences of both participants' individual characteristics and program and context characteristics on participant outcomes. Since one research question focuses on whether program outcomes are the same across different audiences, the project will include at least 200 programs for each of three specific audiences to ensure sufficient statistical power for confidence in the results: primarily African American, primarily Hispanic/Latino, and primarily White.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert PowellMarc SternBrandon Frensley
Many of the Hispanic children and families who live in the Rio Grande Valley lack opportunities to engage in inspirational and educational experiences introducing Science, Technology, Engineering and Mathematics (STEM) concepts and related careers. The University of Texas, Rio Grande Valley (UTRGV) will adapt and research the "Energy and U Show," which will introduce thousands of children and families to an exciting and dramatic that shows interconverting different forms of energy. The show will meld the excitement of chemical demonstrations and the natural connection between energy and STEM education in a fully produced, on-stage science extravaganza. A foundational philosophy of the show is that there is additional real value in getting children and youth onto a college campus. For many of its participants, this is their first time sitting in a seat at a university, the first opportunity for them to envision themselves in this environment. In partnership with the University of Minnesota, which originally developed the show, UTRGV will adapt the show, now presented in English, to a bilingual, culturally accessible format that is designed to Hispanic family audiences and student groups in learning about energy and related careers. Evaluation results demonstrate that the show has effectively engaged thousands of Minnesota students. The target audience will be upper elementary (4th-5th grade), middle school students, and their parents. This project will be led by UTRGV, nation's second-largest Hispanic Serving Institution, with a student enrollment of 28,000, of which over 90% are Hispanic and more than 60% are first-generation college students). In addition to the show, the project will include: (1) a manual to guide implementation of the program and related resources at different national or international venues; (2) educational resources for parents, teachers and school counselors introducing STEM careers and specific STEM college majors; (3) mentoring of UTRGV faculty in outreach activities; and (4) dissemination of the show to other campuses and venues.
The project will conduct ongoing research and evaluation guiding the adaptation of the show and investigation of factors contributing to positive educational impacts of the project, which will be carried out by a bilingual/bicultural researcher. Project research instruments will measure student level of engagement, interest and learning, as well as college interest, in surveys and analysis of data pre and post demonstration. The project will specifically investigate the impact of language on student impacts. Each component of this project will be studied to determine program intervention effectiveness (the scientific demonstration and language of the demonstration). To determine program effectiveness, a baseline of data before program implementation will be established concerning Hispanic students, their persistence, and perceptions of the environment. The project will measure parent perceptions of STEM careers for their children through pre and post demonstration surveys and focus groups. Student and parent research participants will be able to use surveys or respond to other research activities in the language of their choice. Project findings will contribute to the knowledge base concerning how linguistically and culturally adapted science shows and related resources adapted into can have positive impacts regarding the STEM knowledge and careers of students and parents from low-income and Hispanic communities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Karen LozanoArturo FuentesAaron MassariBrian Warren