The summative evaluation documents and articulates what SCIENCES has improved or changed, and in what ways. The final design of the summative evaluation was based on findings from the front-end and formative evaluations, including using participatory evaluation techniques to engage community members in discussing their experience with the programs and assessment of community needs and assets at the close of the project.
The goal of the summative evaluation was to address discrete program impacts in the context of the project, as well as the cross-program impact of providing a thematically
This project will advance efforts of the Innovative Technology Experiences for Students and Teachers (ITEST) program to better understand and promote practices that increase students' motivations and capacities to pursue careers in fields of science, technology, engineering, or mathematics (STEM) by engaging in hands-on field experience, laboratory/project-based entrepreneurship tasks and mentorship experiences.
Twin Cities Public Television project on Gender Equitable Teaching Practices in Career and Technical Education Pathways for High School Girls is designed to help career and technical education educators and guidance counselors recruit and retain more high school girls from diverse backgrounds in science, technology, engineering and math (STEM) pathways, specifically in technology and engineering. The project's goals are: 1) To increase the number of high school girls, including ethnic minorities, recruited and retained in traditionally male -STEM pathways; 2) To enhance the teaching and coaching practices of Career and Technical Education educators, counselors and role models with gender equitable and culturally responsive strategies; 3) To research the impacts of strategies and role model experiences on girls' interest in STEM careers; 4) To evaluate the effectiveness of training in these strategies for educators, counselors and role models; and 5) To develop training that can easily be scaled up to reach a much larger audience. The research hypothesis is that girls will develop more positive STEM identities and interests when their educators employ research-based, gender-equitable and culturally responsive teaching practices enhanced with female STEM role models. Instructional modules and media-based online resources for Minnesota high school Career and Technical Education programs will be developed in the Twin Cities of Minneapolis and St. Paul and piloted in districts with strong community college and industry partnerships. Twin Cities Public Television will partner with STEM and gender equity researchers from St. Catherine University in St. Paul, the National Girls Collaborative, the University of Colorado-Boulder (CU-Boulder), the Minnesota Department of Education and the Minnesota State Colleges and Universities System.
The project will examine girls' personal experiences with equitable strategies embedded into classroom STEM content and complementary mentoring experiences, both live and video-based. It will explore how these experiences contribute to girls' STEM-related identity construction against gender-based stereotypes. It will also determine the extent girls' exposure to female STEM role models impact their Career and Technical Education studies and STEM career aspirations. The study will employ and examine short-form autobiographical videos created and shared by participating girls to gain insight into their STEM classroom and role model experiences. Empowering girls to respond to the ways their Career and Technical Education educators and guidance counselors guide them toward technology and engineering careers will provide a valuable perspective on educational practice and advance the STEM education field.
Digital Observation Technology Skills (DOTS) is a framework for integrating modern, mobile technology into outdoor, experiential science education. DOTS addresses longstanding tensions between modern technology and classical outdoor education by carefully selecting appropriate digital technology for educational purposes and by situating these tools in classical experiential pedagogy.
DATE:
TEAM MEMBERS:
R. Justin HoughamMarc NutterCaitlin Graham
The LiFE Project, an NSF INCLUDES Design and Development Launch Pilot, will investigate and design a collaborative effort to counter the stereotypical expectation that boys are "naturally" better at science and math which becomes a self-fulfilling prophecy, silently shaping the girls'own perceptions of their ability. LiFE collaborators will address this problem at its source: the early learning experiences of elementary school girls. The elementary-middle school period is critical because by 8th grade, many girls have left the STEM pathway forever. The key to reversing the trend is finding effective ways to showcase STEM as a collaborative, people-rich space in which girls can participate together, be themselves, and engage in exploration. Research indicates that girls prefer collaborative activities that can make a difference in the world. Partnering with a coalition of economically and racially diverse New Jersey elementary schools, LiFE will employ "iSTEAM" learning strategies that encourage girls to apply the tools of various disciplines to investigate and solve real-world problems in an open environment of innovation, collaboration, and communication. This approach promises to be especially effective in engaging girls.
LiFE will build on a successful Girls Science Club (GSC) model that introduces girls in grades 3-4 to hands-on iSTEAM exploration activities using Problem/Project-Based Learning strategies. Additional activities will leverage the expertise of the project's corporate/government partners (including Apple and USARMY) to build communication and leadership skills. LiFE will sustain the GSC's benefits by developing clubs for grades 5-6 involving enriched content and long-term independent projects. Eventually, a tiered peer network will link girls from elementary school through women college students and female STEM professionals--each tier mentoring the tiers below. This network will sustain a crucial "sense of community" to retain women in STEM. Within LiFE's social innovation framework approach, participating districts will tailor the GSC to their community while also working together toward shared common goals. LiFE will study the impact of GSCs on persistence of girls' interest in STEM into grade 7. Based on this research, LiFE will develop a cost-effective template that can be replicated across the US. LiFE will bring problem-based iSTEAM concepts to girls of all academic levels in their elementary schools years while, having a community focus with participant-developed projects in a non-competitive environment and leveraging the resources of academic, corporate and government partners to foster broader participation by women in STEM careers.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Bruce BukietJames LipumaNancy Steffen-Fluhr
resourceprojectGames, Simulations, and Interactives
EMERGE in STEM (Education for Minorities to Effectively Raise Graduation and Employment in STEM) is a NSF INCLUDES Design and Development Launch Pilot. This project addresses the broadening participation challenge of increasing participation of women, the at-risk minority population, and the deaf in the STEM workforce. The project incorporates in and out-of-school career awareness activities for grades 4-12 in a high poverty community in Guilford County, North Carolina. EMERGE in STEM brings together a constellation of existing community partners from all three sectors (public, private, government) to leverage and expand mutually reinforcing STEM career awareness and workforce development activities in new ways by using a collective impact approach.
This project builds on a local network to infuse career exposure elements into the existing mutually reinforcing STEM activities and interventions in the community. A STEM education and career exposure software, Learning Blade, will be used to reach approximately 15,000 students. A shared measurement system and assessment process will contribute to the evaluation of the effectiveness of the collective impact strategies, the implementation of mutually reinforcing activities across the partnership and the extent to which project efforts attract students to consider STEM careers.
DATE:
-
TEAM MEMBERS:
Gregory MontyMargaret KanipesMalcolm SchugSteven Jiang
This project is a Design and Development Launch Pilot (DDLP) of the NSF INCLUDES program. The goal of the project is to enhance the knowledge and applicability of science, technology, engineering, and mathematics (STEM) for a broad cross-section of people living in the U.S,-Affiliated Pacific Islands. The focus will be on water resources, which is an extremely important topic for this region and equally relevant nationally. The project will engage local community groups and schools in water monitoring, sampling, and analysis, in order to promote the benefits of science education and careers among a population that is underrepresented in these areas. Moreover, the project will improve the capabilities of the island residents for making decisions about sustainable use and protection of these scarce resources. A functioning network will be established among the islands that will have a positive impact on the health and well-being of the residents.
This project will use water as a highly relevant topic in order to involve a wide range of individuals in both general STEM learning and the basic scientific principles as applied to water resources. Specific aspects include engaging K-12, higher education, informal educators and community members to manage water resources in a sustainable fashion that will reduce disaster risk. In addition, the project will empower local communities through water literacy to make better informed, evidence-based decisions that balance the needs of diverse stakeholder groups. The overarching goal is to further advance the inclusion of underrepresented learners in STEM fields. Benefits to society will accrue by: increasing STEM learning opportunities for ~6,500 students from underserved and underrepresented Indigenous Pacific Islanders that will enhance their eligibility for STEM careers; building community resiliency through a collective impact network to resolve emerging water crises; and fostering collaboration among different constituencies in remote communities to make better-informed decisions that reflect the needs and constraints of diverse interests.
Community colleges play a vital role in educating undergraduate students. These higher education institutions educate nearly half of the nation's undergraduate students, particularly among low-income and first-generation students and students of color. Because of the rich diversity that currently exists at these institutional-types, there are immense opportunities to broadening participation throughout the engineering enterprise. To this end, the investigator outlines a joint collaboration with five community colleges, three school systems, two college career academies, and a state partner in Georgia - referred as the Georgia Science, Technology, and Engineering Partnerships for Success (GA STEPS) - to provide dual enrollment classes in career pathways for Georgia high school students in grades 9-12, thereby allowing secondary students to earn college credit. The Georgia STEPS program proposes to leverage mechatronics engineering as a means for broadening engineering participation for community colleges and underserved, underrepresented populations in 48 rural counties to increase engineering awareness, skills training and college and career readiness. The project builds on an existing collaboration that has developed successful engineering opportunities at the community college level, by including a wider regional network of rural Georgia counties and high schools. Further, this project has immense potential to transform engineering education and course-taking for students at the secondary and postsecondary level in Georgia and beyond. It has potential great potential to be scaled and replicated at other placed around the United States.
The project's intellectual merit and innovation is that it leverages a successful mechatronics engineering curriculum that supports engineering skills that support local industry as well as supporting innovations in the mechatronics field. The project includes a collective impact framework, involving various stakeholders and aligning quantitative and qualitative metrics and measurable objectives. The broader impacts of this project is that it increases the engineering knowledge and skills of underserved, underrepresented students that are enrolled in community colleges. Also, the impact to rural communities in Georgia support the fact that this project would meet broader groups that can be positively impacted by this type of collaborative. The ability to provide different parts of this engineering discipline across broad audiences in community colleges - that support underrepresented groups understanding of mechatronics engineering - is broadly useful to the field of engineering.
This article discusses the Youth in Science Action Club (SAC), which uses citizen science to investigate nature, document their discoveries, share data with the scientific community, and design strategies to protect the planet. Through collaborations with regional and national partners, SAC expands access to environmental science curriculum and training resources.
DATE:
TEAM MEMBERS:
Laura HerszenhornKatie LevedahlSuzi Taylor
To address the need for STEM reform in K-12 schools, this article describes the design and implementation of a rigorous, interdisciplinary science and research program (ISR) in two local high schools (HS-S and HS-H). The ISR, adapted from the successful School for Science and Math at Vanderbilt program, provides seven courses over four years that focus on the development of critical thinking skills and the ability to construct and perform hypothesis-driven research projects. The courses are co-taught by a science teacher (masters or doctoral level) and a Ph.D. scientist. Overall, students in
DATE:
TEAM MEMBERS:
Jennifer A. UfnarVirginia L. Shepherd
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative research, approaches and resources for use in a variety of settings. In this exploratory Change Makers project, the Concord Consortium will develop, test, and evaluate a citizen science program that leverages innovative technology, such that youth engage directly with energy issues through scientific inquiry. The project will create the Infrared Street View, a citizen science program that aims to produce a thermal version of Google's Street View using an affordable infrared camera attached to a smartphone. The infrared camera serves as a high-throughput data acquisition instrument that collects thousands of temperature data points each time a picture is taken. Youth will collect massive geotagged thermal data that have considerable scientific and educational value for visualizing energy usage and improving energy efficiency at all levels. The Infrared Street View program will provide a Web-based platform for youth and anyone interested in energy efficiency to view and analyze the aggregated data to identify possible energy losses. By sharing their scientific findings with stakeholders, youth will make changes to the way energy is being used. The project will start with school, public, and commercial buildings in selected areas where performing thermal scan of the buildings and publishing their thermal images for educational and research purposes are permitted by school leaders, town officials, and property owners. In collaboration with high schools and out-of-school programs in Massachusetts, this project will conduct pilot-tests with approximately 200 students.
To contribute to advancing learning, the study will probe three research questions: 1) Under what circumstances can technology bridge out-of-school and classroom science learning and improve learning on both sides? 2) To what extent can unobtrusive assessment based on data mining support research and evaluation of student learning in out-of-school settings? and 3) To what extent can instructional intelligence built into the app used in the program help students learn in out-of-school programs and improve the quality of data they contribute to the citizen science project? Data sources for investigating these questions include students' interaction data with the app logged behind the scenes and the images they have taken, as well as results based on traditional assessments from a small number of participants. Throughout the project, staff will widely disseminate project products and findings through the Internet, science fairs, conferences, publications, and partner networks. An eight-member Advisory Board consisting of cleantech experts, science educators, and educational researchers will oversee and evaluate this project.
One common barrier to STEM engagement by underserved and underrepresented communities is a feeling of disconnection from mainstream science. This project will involve citizen scientists in the collection, mapping, and interpretation of data from their local area with an eye to increasing STEM engagement in underrepresented communities. The idea behind this is that science needs to start at home, and be both accessible and inclusive. To facilitate this increased participation, the project will develop a network of stakeholders with interests in the science of coastal environments. Stakeholders will include members of coastal communities, academic and agency scientists, and citizen science groups, who will collectively and collaboratively create a web-based system to collect and view the collected and analyzed environmental information. Broader impacts include addressing the STEM barriers to those who reside in the coastal environment but who are underrepresented in STEM education, vocations and policy-making. These include tribal communities (racial and ethnic inclusion), fishery communities (inclusion of communities of practice), and rural communities without direct access to colleges or universities. This project will create a physical, a social, and a virtual, environment where all participants have an equal footing in the processes of "doing science" - the Coastal Almanac. The Almanac is simultaneously a network of individuals and organizations, and a web-based repository of coastal data collected through the auspices of the network. During the testing phase, the researchers will implement the "rules of engagement" through multiple interaction pathways in the growing Coastal Almanac network: increases in rigorous citizen science, development of specific community-scientist partnerships to collect and/or use Almanac data, development of K-12 programs to collect and/or use Almanac data. The proposed work will significantly scale up citizen science and community-based science programs on the West Coast, broadening participation by targeting members of coastal communities with limited access to mainstream science, including participants from non-STEM vocations, and Native Americans. The innovation of the Coastal Almanac is in allowing the process of deepening involvement in science, and through that process increasing agency of community members to be bona fide members of the science team, to evolve organically, in the manner dictated by community members and the situation, rather than a priori by the project team and mainstream science. The project has the potential in the long-term to increase participation in marine science education, workforce, and policy-making by underrepresented groups resident in the coastal environment. Contributions by project citizen scientists will also provide valuable data to mainstream science and to resource management efforts.
DATE:
-
TEAM MEMBERS:
Julia ParrishMarco HatchSelina Heppell
This is a two-year "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot targeting high school students in the Hudson Valley, including the New York Metropolitan Area. It will support a network of institutional partners that are committed to providing internship and mentoring opportunities to youths interested in authentic research projects. The proposed work will build on a current research immersion program--the Secondary School Field Research Program (SSFRP) at Columbia University's Lamont-Doherty Earth Observatory. SSFRP serves high school students, mainly from underrepresented and underserved communities, who work with college students, science teachers, and researchers around a specific science problem. Over the past decade, the program has had demonstrable impact, including attendance to college, and students' selection of STEM majors. Tracking data indicates that retention rates of its alumni in four-year colleges are well above the norm, and a significant fraction of early participants are now in graduate programs in science or engineering. The program has surpassed all expectations in its effectiveness at engaging underserved populations in science and promoting entry into college, recruitment into STEM majors, and retention through undergraduate and into graduate studies. Hence, the project's overall goal will be to extend and adapt the research-immersive summer internship model through an alliance with peer research institutions, school districts and networks, public land and resource management agencies, private funding agencies, informal educational institutions, and experts in pedagogical modeling, metrics, and evaluation. Focused on earth and environmental sciences, the summer and year-round mentoring model will allow high school students to work in research teams led by college students and teachers under the direction of research scientists. The mentoring model will be multilayered, with peer, near-peer, and researcher-student relationships interweaving throughout the learning process.
The project has formulated a set of testable explanatory hypotheses: (1) Beyond specific subject knowledge, success rests on increased student engagement in a community of practice, with near-peer mentors, teachers, and scientists in the context of scientific research; (2) The intensity of engagement also shifts the students' vision of their future to include higher education, and specifically to imagine and move toward a STEM career; and (3) Early engagement, before students attend college, is critical because high school is where students form patterns of engagement and capacities related to science learning. Thus, the immediate goal of the two-year plan will be to create approximately 11 research internship programs focused on earth and environmental sciences, and to build the networks for growth through engagement with a wider community of educational partners. The main focus of this approach will be removing barriers between high school students and STEM organizations, and adapting the current mentoring model at Columbia University to the specific cultures of other research groups and internship programs throughout the lower Hudson Valley. The team has already assembled a diverse set of partners committed to broadening participation in STEM using a collective impact approach to early engagement in project-based learning. Research partners will provide the mentors, research projects, and laboratory facilities. The educational network partners will provide access for students, particularly those from under-resourced communities to participate, as well as participation opportunities for interested teachers. Informal learning organizations will provide access to field and research sites, along with research dissemination opportunities. In Year 1, the project will conduct a series of development workshops for partners already in place and foster the formation of new partnership clusters according to shared interest, complementary resources and geographic proximity. The workshops will provide a forum for partners to learn about each other's visions, values, challenges, and existing structures, while working through theoretical and practical issues related to STEM engagement for young investigators. In Year 2, the project will target the implementation of the internship programs at various sites according to the agreed-upon goals, program model, research projects, recruitment and retention strategy, staff training, data collection, and evaluation plans. An external evaluator will address both the formative and summative evaluation of the effort directed toward examining the three project's hypotheses concerning the educational impacts of scientific research on student engagement, extent of the immersion, and overall effectiveness of the programs.
DATE:
-
TEAM MEMBERS:
Robert NewtonLuo Cassie XuMargie TurrinEinat LevMatthew Palmer