Program evaluators from the Education Development Center (EDC) used a mixed-methods, quasi-experimental design to evaluate the impact on girls’ awareness and interest in science, technology, engineering, and mathematics (STEM). After the final year of the project, EDC delivered a summative report to Techbridge Girls (TBG), which was based on data collected during the five-year grant period, with a particular focus on the final year that grant funds supported programming (2017-18). Data included pre- and post-surveys with TBG participants and comparison students, participant focus groups, and
For nearly 20 years, the UAB Center for Community OutReach Development (CORD) has conducted SEPA funded research that has greatly enhanced the number of minority students entering the pipeline to college and biomedical careers, e.g., nearly all of CORD’s Summer Research Interns since 1998 (>300) have completed/are completing college and most of them are continuing on to graduate biomedical research and/or clinical training and careers. CORD’s programs that focused on high and middle school students have drawn many minority students into biomedical careers, but a low percentage of minority students benefit from these programs because far too many are already left behind academically in grades 4-6, due, at least in part, to a significant drop in science grades between grades 4 and 6, a drop from which most students never recover. A major contributor to this effect is that most grade 4-6 teachers in predominantly minority schools lack significant formal training in science and often are not fully aware of the great opportunities offered by biomedical careers.
In SEEC II, CORD will deliver intensive inquiry-based science training to grade 4-6 teachers, providing them with science content and hands-on science experiences that will afford their student both content and skills that will make them excited about, and competitive for, the advanced courses needed to move into biomedical research careers. SEEC II will also link teachers together across the elementary/middle school divide and bring the teachers together with administrators and parents, who will experience firsthand the excitement that inquiry learning brings and the significant advancement it provides in science and in reading and math. At monthly meetings and large annual celebrations, the parents, teachers and administrators will learn about the opportunities that biomedical careers can provide for the student who is well prepared. They will also consider the financial and educational steps required to ensure that students have the ability to reach these professions.
SEEC II will also expand CORD’s middle school LabWorks and Summer Science Camps to include grade 4-5 students and provide the teachers with professional learning in informal settings. During summer training, in small groups, the teachers will expand one of the inquiry-based science activities that they complete in the training, and they will use these in their classrooms and communicate with the others in their group to perfect these experiences in the school year. Finally, the teachers and grade 4-5 students will develop science and engineering fair-type research projects with which they will compete both on the school level and at the annual meeting. Thus, the students will share with their parents the excitement that science brings. The Intellectual Merit of SEEC II will be to test a model to enhance grade 4-6 teacher development and vertical alignment, providing science content, exposure to biomedical scientists and training in participatory science experiments, thus positioning teachers to succeed. The Broader Impacts will include the translation and testing of a science education model to assist minority students to avoid the middle school plunge and reach biomedical careers.
Underrepresented minorities (URMs) represent 33% of the US college age population and this will continue to increase (1). In contrast, only 26% of college students are URMs. In the area of Science Technology, Engineering and Mathematics (STEM), only 15% of college students completing a STEM major are URMs (2). While there have been gains in the percent of Hispanic and Black/African Americans pursuing college degrees, the number of Native American college students remains alarmingly low. In 2013, Native Americans represented only 1% of entering college students and less than 50% finished their degree. Moreover, 1% of students pursuing advanced degrees in STEM-related fields are Native American/Alaska Native. With regards to high school graduation rates, the percent of Native American/Alaska Native students completing high school has decreased with only 51% of students completing high school in 2010 compared to 62 % and 68% for Black and Latino students respectively. While identifying ways to retain students from all underrepresented groups is important, developing programs targeting Native American students is crucial. In collaboration with the Hopi community, a three-week summer course for Native American high school students at Harvard was initiated in 2001. Within three years, the program expanded to include three additional Native American communities. 225 students participated in the program over a 10-year period; and 98% of those responding to the evaluation completed high school or obtained a GED and 98% entered two or four year colleges including 6 students who entered Harvard. This program was reinitiated in 2015 and we plan to build on the existing structure and content of this successful program. Specifically, in collaboration with two Native American communities, the goal of the program is 1) to increase participants’ knowledge of STEM disciplines and their relevance to issues in participants’ communities via a three week case-based summer course for Native American high school students; 2) to help enhance secondary school STEM education in Native American communities by providing opportunities for curriculum development and classroom enhancement for secondary school teachers in the participating Native American communities; and 3) to familiarize students with the college experience and application process and enhance their readiness for college through workshops, college courses and internships. Through these activities we hope to 1) increase the number of Native American students completing high school; 2) increase the number of Native American students applying and being accepted to college; 3) increase the number of Native American students pursuing STEM degrees and careers; 4) increase the perception among Native American students that attending and Ivy plus institution is attainable; 5) increase the feeling of empowerment that they can help their community by pursuing advanced degrees in STEM.
PUBLIC HEALTH RELEVANCE:
This proposal supports a summer program for high school students and teachers from Native American communities. The program goals are to encourage students to complete high school and prepare them for college and to also consider degrees in science, technology, engineering, and math.
The purpose of the proposed project, Community of Bilingual English-Spanish Speakers Exploring Issues in Science and Health (CBESS), is to increase linguistic diversity in science, technology, engineering, and math (STEM)-healthcare fields, including biomedical, behavioral, and clinical research careers. With support of the large group of Spanish-English bilingual (SEB), STEM-healthcare professionals that was formed during this proposal preparation, CBESS will contribute to the pipeline between K–12 and higher education/career.
CBESS will recruit Spanish-English bilingual (SEB) high-school students at the end of tenth grade and implement several language-supported STEM-healthcare interventions during the eleventh and twelfth grade (17 months): family-engaged career exploration; Next Generation Science Standards (NGSS)-aligned, inquiry-based, youth-led summer research residential program; community outreach/dissemination, internships, and mentoring.
Applying methods that are known to be effective with the target population, CBESS will also train undergraduate, near-peer instructor-mentors—STEM-healthcare Leadership Trainees (LT)—in inquiry-based instruction and strategies for positioning K–12 bilingual students as “insiders” in STEM-healthcare, as well as in the responsible conduct of research and mentoring skills, followed by practical application with SR.
CBESS will develop and expand the nascent SEB STEM-healthcare community of practice (CoP) that was created during CBESS proposal preparation. Committed academic, clinical, research, and community partners will contribute to research and evaluation efforts, and support the pipeline between K–12 and higher education/career through Community Based Participatory Research (CBPR), framing priority community health issues to be addressed by each cohort of SR from among issues identified by the SR during the application process. Finally, the CoP will target long-term institutional sustainability for linguistically diverse students in STEM-healthcare education and careers.
For public health to improve, all sectors of society much have access to the highest quality health science news and information possible. How that information is translated, packaged and disseminated is important: the stories matter. Our journalism and mentoring program will grow the health science literacy of the nation by building the next generation of science communicators, ensuring that cadre of youth from historically disadvantaged groups have the discipline, creativity and critical thinking skills needed to be successful health science-literate citizens and advocates within their own communities.
Using a combination of youth-generated videos, broadcast reporting and online curriculum resources, PBS NewsHour will engineer successful educational experiences to engage students from all backgrounds, and particularly underserved populations, to explore clinical, biomedical, and behavioral research. The PBS NewsHour’s Student Reporting Labs program, currently in 41 states, will create 10 health science reporting labs to produce unique news stories that view health and science topics from a youth perspective. We will incorporate these videos into lesson plans and learning tools disseminated to the general public, educators and youth media organizations. Students will be supported along the way with curricula and mentorship on both fundamental research and the critical thinking skills necessary for responsible journalism. This process will ensure the next generation includes citizens who are effective science communicators and self-motivated learners with a deep connection to science beyond the textbook and classroom.
PBS NewsHour will develop a STEM-reporting curriculum to teach students important research skills. The program will include activities that expose students to careers in research, highlight a diverse assortment of pioneering scientists as role models and promote internship opportunities. The resources will be posted on the PBS NewsHour Extra site which has 170,000 views per month and our partner sites on PBS Learning Media and Share My Lesson—the two biggest free education resource sites on the web—thus greatly expanding the potential scope of our outreach and impact.
NewsHour broadcast topics will be finalized through our advisory panel and the researchers interviewed for the stories will be selected for their expertise and skills as effective science communicators, as well as their diversity and ability to connect with youth. Finally, we will launch an outreach and community awareness campaign through strategic partnerships and coordinated cross promotion of stories through social media platforms.
This project specifically addresses the SMRB’s imperative that “NIH’s pre-college STEM activities need a rejuvenated integrated focus on biomedical workforce preparedness with special considerations for under-represented minorities.”
Approximately one-third of CityLab’s participants are under-represented minority (URM) students, but we now have a unique opportunity to build a program that will reach many URM students and position them for undergraduate STEM success. We have partnered with urban squash education organizations in Boston (SquashBusters) and New York (CitySquash and StreetSquash) that recruit URM/low SES students to participate in after-school squash training and academic enrichment programs. We have also partnered with the Squash + Education Alliance (previously named the National Urban Squash and Education Association) to disseminate the new program—first from Boston to New York and later through its national network of affiliated squash education programs.
In order to bring this project to fruition, Boston University is joining forces with Fordham University in New York. Fordham is home to CitySquash so these organizations provide an ideal base for the New York activities. The proposed project will enable us to demonstrate feasibility and replicability within the 5-year scope of this grant. Our shared vision is to develop a national model for informal precollege biomedical science education that can be infused into a myriad of similar athletic/academic enrichment programs.
The squash education movement for urban youth has been highly successful in enrolling program graduates in college. Since the academic offerings of the squash education programs focus on English Language Arts and Mathematics, their students struggle with science and rarely recognize the tremendous opportunities for long- term employment in STEM fields.
This project will bring CityLab’s resources to local squash programs in a coordinated and sustained engagement to introduce students to STEM, specifically the biomedical sciences. Together with the urban squash centers, we will build upon the hands-on life science experiences developed and widely disseminated by CityLab to create engaging laboratory-based experiences involving athletics and physiology.
The specific aims of the proposed project are:
To develop, implement, and evaluate a new partnership model for recruiting URM/low SES students and inspiring them to pursue careers in STEM; and
To examine changes in the science learner identities (SLI) of the students who participate in this program and establish this metric as a marker for continued engagement in STEM.
With the involvement of the two urban research universities, three local squash education programs, and SEA, we see this new SEPA initiative as a unique way to pilot, refine, and disseminate an after-school/informal science education program that can have a significant impact on the nation’s production of talented STEM graduates from URM/low SES backgrounds.
DATE:
-
TEAM MEMBERS:
Carl FranzblauDonald DeRosaCarla Romney
resourceprojectProfessional Development, Conferences, and Networks
This broadening participation project will focus on a regional workshop aimed at increasing Historically Black Colleges and Universities' (HBCUs) capacity to develop high quality proposals for future competitions of various programs in the Division of Research on Learning. The proposed effort will occur through three specific steps involving a: (1) pre-workshop webinar to introduce and lay the foundation for the opportunity; (2) full two-day workshop to engage participants in a rigorous grant-writing exercise; and (3) post workshop follow-up to provide ongoing support and proposal development guidance. Through a theory-driven process, the goal is to establish some degree of conformity for maximizing grant productivity around strategies and ideas shown to be effective in retaining students in the STEM pipeline.
The multi-tiered workshop will establish a launching pad for increasing attendees' capacity to build on prior knowledge and use best practices to improve future grant writing efforts. Specialized activities will help prepare HBCUs to increase their contributions to diversifying the future STEM workforce, support innovation and creativity in STEM fields, expand networking strategies, and promote opportunities to learn. Central to this capacity-building effort will be a focus on understanding the current research context and expectations for competitive participation in funding opportunities offered by NSF. This, in turn, will align with the Foundation's strategic direction for broadening participation in STEM through meaningful cutting-edge STEM education research. Resources from the workshop will be made available online to facilitate broader dissemination of information beneficial to HBCUs and other education institutions engaging in broadening participation efforts.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This project will examine the characteristics and outcomes of a large sample of environmental education field trip programs for youth to elucidate program characteristics that most powerfully influence 21st century learning outcomes. Environmental education programs for youth, particularly day-long school trip programs, are popular and reside at the intersection of formal and informal STEM education. Such field trips provide opportunities for diverse audiences to participate in shared learning experiences, but current understanding of what leads to success in these programs is limited. This large-scale study will address this gap in knowledge by investigating the linkages between program characteristics and participant outcomes for at least 800 single-day environmental education field trip programs for youth in grades 5-8, particularly programs for diverse and underserved audiences. This study will result in the identification of evidence-based practices that will inform future program design for a wide variety of settings, including nature centers, national parks, zoos, museums, aquaria, and other locations providing informal environmental education programs.
This Research in Service to Practice study is guided by two research questions: 1) What program characteristics (context, design, and delivery) most powerfully influence learner self-determination and learner outcomes? And 2) Do the most influential program characteristics differ across diverse and underserved audiences (e.g. African American, Hispanic/Latino, economically disadvantaged) and contexts (e.g. rural versus urban)? This project will examine a wide range of program-related factors, including pedagogical approaches and contextual characteristics. A valid and reliable protocol for observing 78 program characteristics hypothesized to influence learner outcomes developed by a previous project will be used to systematically sample and observe 500 single-day environmental education field trip programs for youth in grades 5-8 distributed across at least 40 U.S. states and territories. Programs for diverse and underserved youth will be emphasized, and a diverse set of programs in terms of program type and context will be sought. Data from this sample will be combined with those of an existing sample of 334 programs provided by over 90 providers. The final combined sample of over 800 programs will provide sufficient statistical power to confidently identify which program components are most consistently linked with learning outcomes. This sample size will also enable stratification of the sample for examination of these relationships within relevant subpopulations. Principal component analyses will be used to reduce data in theoretically meaningful and statistically valid ways, and multilevel structural equation modeling will be employed to examine the influences of both participants' individual characteristics and program and context characteristics on participant outcomes. Since one research question focuses on whether program outcomes are the same across different audiences, the project will include at least 200 programs for each of three specific audiences to ensure sufficient statistical power for confidence in the results: primarily African American, primarily Hispanic/Latino, and primarily White.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Robert PowellMarc SternBrandon Frensley
Recognizing that race can influence African American youths' perception of which academic disciplines and careers are available to them, this pilot study will explore how African American youths' physical and social communities can be leveraged to support the evolution of their STEM identity and their ability to recognize their potential as scientists. Unfortunately, many of these youths live in communities that are void of critical resources that research has demonstrated time and time again are critical for success in STEM disciplines and careers. This lived reality for many African American youth is the direct result of long-standing disparities in access and opportunities, fueled by racial socialization and biased institutional structures. This pilot will empower youth to recognize these disparities and use science to provide solutions. One perilous societal disparity experienced in many predominately African American communities is the lack of access to fresh produce and healthy food. As a mechanism for potential resolution, this project will consider the utility of community gardens to address this important community need and as a strategy to engage youth in STEM content and skill development. While this notion is not novel to NSF, the intent to utilize an augmented reality (AR) storytelling platform for data collection and project experiences is innovative. This technology will also provide a space for participants to share their work with each other and their broader communities. To our knowledge, this pioneering approach has not been previously piloted in this context. In addition, the pilot will engage multiple youth serving community-based organizations such as park and recreation centers and faith-based organizations in this work, which is also innovative. This is significant, as youth serving community-based organizations are often play important role in the social, educational, and cultural lives of youth and their families in communities. These organizations are often at the heart of the community, figuratively and literally. If successful, this pilot could be transformative and provide a strong basis to support similar work in other communities.
Over the two-year project duration, eighty African American youth ages 11 -14 will participate in the year-long program, across three youth-serving, community-based organizations at four sites. They will be exposed to relevant agricultural, geological, engineering and technological content through a newly developed curriculum called "Cultivating My Curriculum." Community mentors and undergraduate role models will facilitate the instruction and hands-on experiences in the garden and with the AR platform. A capstone event will be a held for the participants and community to convene to learn more about the results of the pilot and share recommendations with community leaders for improving the disparities identified during the pilot. The research component will focus on: (a) the impact of the sociocultural theoretical framework grounding the work on youths' STEM identities, (b) the integration of the AR tool, and (c) mentorship. Formative and summative evaluation will take place through focus groups, surveys, journals, and youth storytelling. Ultimately, the project endeavors to advance the narrative that African Americans are scientists and that science can be used to improve the lives of African Americans and other groups challenged by structural and racial disparities.
This pilot study is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Harrison PinckneyDavid BoyerBarry GarstDilrukshi Thavarajah
Many of the Hispanic children and families who live in the Rio Grande Valley lack opportunities to engage in inspirational and educational experiences introducing Science, Technology, Engineering and Mathematics (STEM) concepts and related careers. The University of Texas, Rio Grande Valley (UTRGV) will adapt and research the "Energy and U Show," which will introduce thousands of children and families to an exciting and dramatic that shows interconverting different forms of energy. The show will meld the excitement of chemical demonstrations and the natural connection between energy and STEM education in a fully produced, on-stage science extravaganza. A foundational philosophy of the show is that there is additional real value in getting children and youth onto a college campus. For many of its participants, this is their first time sitting in a seat at a university, the first opportunity for them to envision themselves in this environment. In partnership with the University of Minnesota, which originally developed the show, UTRGV will adapt the show, now presented in English, to a bilingual, culturally accessible format that is designed to Hispanic family audiences and student groups in learning about energy and related careers. Evaluation results demonstrate that the show has effectively engaged thousands of Minnesota students. The target audience will be upper elementary (4th-5th grade), middle school students, and their parents. This project will be led by UTRGV, nation's second-largest Hispanic Serving Institution, with a student enrollment of 28,000, of which over 90% are Hispanic and more than 60% are first-generation college students). In addition to the show, the project will include: (1) a manual to guide implementation of the program and related resources at different national or international venues; (2) educational resources for parents, teachers and school counselors introducing STEM careers and specific STEM college majors; (3) mentoring of UTRGV faculty in outreach activities; and (4) dissemination of the show to other campuses and venues.
The project will conduct ongoing research and evaluation guiding the adaptation of the show and investigation of factors contributing to positive educational impacts of the project, which will be carried out by a bilingual/bicultural researcher. Project research instruments will measure student level of engagement, interest and learning, as well as college interest, in surveys and analysis of data pre and post demonstration. The project will specifically investigate the impact of language on student impacts. Each component of this project will be studied to determine program intervention effectiveness (the scientific demonstration and language of the demonstration). To determine program effectiveness, a baseline of data before program implementation will be established concerning Hispanic students, their persistence, and perceptions of the environment. The project will measure parent perceptions of STEM careers for their children through pre and post demonstration surveys and focus groups. Student and parent research participants will be able to use surveys or respond to other research activities in the language of their choice. Project findings will contribute to the knowledge base concerning how linguistically and culturally adapted science shows and related resources adapted into can have positive impacts regarding the STEM knowledge and careers of students and parents from low-income and Hispanic communities.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
DATE:
-
TEAM MEMBERS:
Karen LozanoArturo FuentesAaron MassariBrian Warren
There are several critical reasons to understand and support interest development in early childhood: (a) as a primary motivator of engagement and learning; (b) interest development in preschool predicts important learning outcomes and behaviors in early elementary school; and (c) early childhood interests motivate ongoing interest development. Thus, there is growing recognition that interest is not just important but fundamental to education and learning. Head Start on Engineering (HSE) is a multi-component, bilingual (Spanish/English), family-focused program designed to (1) foster long-term interest in the engineering design process for families with preschool children from low-income backgrounds and (2) support family development and kindergarten readiness goals. The HSE program, co-developed with the Head Start community, provides families with developmentally appropriate, story-based engineering design challenges for the home and then connects these to a system of strategically aligned Informal STEM Education (ISE) experiences and resources. This current project, HSE Systems, builds on a previous HSE Pathways project which (a) established that participating families develop persistent engineering-related interests; (b) highlighted the value that the Head Start community has for the program and partnership; and (c) generated a novel, systems perspective on early childhood interest development. The aim of HSE Systems is to develop and test a model of early childhood STEM engagement and advance knowledge of how the family as a system develops interest in STEM from preschool into kindergarten.
Through the Design Based Implementation Research (DBIR) process, the team will iteratively refine and improve the HSE program and theory of change using ongoing feedback and data from staff, families, and partners. It is also designed to explore program impacts on family interest development over a longer period, as children enter kindergarten. The DBIR work will focus primarily on the program model questions, while the case study research will focus on the family interest questions, with both strands informing each other. The initial work is organized around a series of feedback and design-testing cycles to gather input from families and other stakeholders, update the program components and activities in collaboration with families and staff, and prepare for full implementation. During the next phase, the team will implement the full program model with six Head Start classrooms and track family experiences and interest development into kindergarten. During final implementation phase, the team will finish data collection, conduct retrospective analysis with all the data, and update the program model and theory of change.
This project will directly address the AISL program goals by broadening access to early childhood informal STEM education for low-income communities, with a focus on Spanish-speaking families, and building long-term skills and learning dispositions to support STEM learning inside and outside of school. Beyond the topic of engineering, HSE supports Head Start school readiness and child and family development goals, which are the foundation of lifelong success.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Museums in the US receive approximately 55 million visits each year from students in school groups. Field trip visits to an art museum have been found to positively impact critical thinking skills, empathy and tolerance - an increase that can be even more significant for youth from rural or high-poverty regions. While field trips are popular, especially at science museums, there have been no experimental studies about their impact on STEM career choices and interests, much less any which used a culturally sensitive and responsive approach. Given the resources put into field trips, this study investigates if causal links can be drawn between museum experiences and impact on youth. The Museum of Science & Industry uses a Learning Labs approach for engaging its visitors. These "Learning Labs" are facilitated experiences that run roughly an hour. Currently there are 12 lab topics. This study focuses on MedLab--one of the learning labs--as the setting for the research. MedLab is designed for on-site and online experience using ultra-sophisticated and highly versatile technology in challenges taken from research on the top healthcare issues that face adolescents in their communities.
This study is informed by research and theory on Social Cognitive Career Theory (SCCT) and Racial and Ethnic Identity. The former describes a process many follow when thinking about career options, broadly. The latter describes how people see themselves in the world through their membership with a racial and/or ethnic group. Both processes can collectively influence STEM career choices. This study follows an embedded mixed-method design. The quantitative portion includes an experimental, pre/post/delayed post-test design of both educators and their students using multiple measures taken mostly from previously published instruments. The qualitative portion includes observation rubrics of MedLab sessions along with interviews and focus groups with staff, educators, students and families that take place both within and outside of the museum. This is an experimental study of moderate size of both heterogeneous teacher and student populations in real world settings. It involves comparing youth and educators that participate in MedLab with those who do not. By conducting research that looks at each community through the lens of their unique experiences, the research will measure their impact more sensitively and authentically, addressing a gap in current literature on informal science, technology, engineering, or mathematics (STEM) career education with diverse students.
This study is funded by the Advancing Informal STEM Learning (AISL) program and the Innovative Technology Experiences for Students and Teachers (ITEST) program.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.