EvaluATE is a national resource center dedicated to supporting and improving the evaluation practices of approximately 250 ATE grantees across the country. EvaluATE conducts webinars and workshops, publishes a quarterly newsletter, maintains a website with a digital resource library, develops materials to guide evaluation work, and conducts an annual survey of ATE grantees. EvaluATE's mission is to promote the goals of the ATE program by partnering with projects and centers to strengthen the program's evaluation knowledge base, expand the use of exemplary evaluation practices, and support the continuous improvement of technician education throughout the nation. EvaluATE's goals associated with this proposal are to: (1) Ensure that all ATE Principal Investigators and evaluators know the essential elements of a credible and useful evaluation; (2) Maintain a comprehensive collection of online resources for ATE evaluation; (3) Strengthen and expand the network of ATE evaluation stakeholders; and (4) Gather, synthesize, and disseminate data about the ATE program activities to advance knowledge about ATE/technician education. The Center plans to produce a comprehensive set of evaluation resources to complement other services, engaging several community college-based Principal Investigators and evaluators in that process.
EvaluATE's products are informed by current research on evaluation, the National Science Foundation's priorities for the evaluation of ATE grants, and the needs of ATE PIs and evaluators for sound guidance that is immediately relevant and usable in their contexts. The fundamental nature of EvaluATE's work is geared toward supporting ATE grantees to use evaluation regularly to improve their work and demonstrate their impacts. All of EvaluATE's products are available to the public. EvaluATE's findings from the annual survey of ATE grantees aid in advancing understanding of the status of technician education and illuminate areas for additional research. The new survey investigates ATE grantees' work to serve underrepresented and special populations, including women, people of color, and veterans. Survey data are available upon request for research and evaluation purposes.
DATE:
-
TEAM MEMBERS:
Lori WingateArlen GullicksonEmma PerkKelly RobertsonLyssa Becho
resourceprojectProfessional Development, Conferences, and Networks
The National Science Foundation's (NSF) Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) intiative supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The University of Cincinnati, lead for a tri-state (OH, KY, IN) project, will convene a three-day conference to convene national and local experts to explore the best practices that support the development of a backbone organization in the context of using a social innovation model for broadening participation in STEM. The intent is to strengthen the network among participants and leverage learning from the Cincinnati Strive experience with collective impact across the Midwest and beyond.
Results from the NextLivesHere: Social Change Innovation Summit, will be disseminated in the tri-state region through the Greater Cincinnati STEM Collaborative (GCSC and the Ohio STEM Learning Network (OSLN). National dissemination will occur through informal and formal STEM professional organizations and publications as well as through participation in the NSF-developed national backbone organization.
DATE:
-
TEAM MEMBERS:
Kathie MaynardRoss MeyerShiloh TurnerGeoffrey ZimmermanGisela Escoe
resourceprojectProfessional Development, Conferences, and Networks
The NSF INCLUDES program supports models, networks, partnerships and research to ensure the broadening participation in STEM of women, members of racial and ethnic groups that have been historically underrepresented, persons of low socio-economic status, and people with disabilities.
The University of California-Irvine (UCI), in partnership with the University of California-San Diego and the University of California-Davis will convene a state-wide conference on inclusion in science, technology, engineering and mathematics (STEM) higher education. The California STEM INCLUDES Conference and Network will share best practices for promoting STEM inclusion and provide an infrastructure to further these practices and track the outcomes. The purpose of the conference is to form a backbone for a large regional network in support of the National Science Foundation's Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) initiative.
The five goals of the conference are to:
--increase California educator awareness of demographic gaps in STEM participation and the research on factors influencing such participation gaps;
--engage participants in discussion of promising practices for increasing STEM inclusion
--broaden the impact of existing successful programs for STEM inclusion, through program modification and replication, scale-up, and increased collaboration;
--create a mechanism for sustained discussion, sharing and collaboration around STEM inclusion across California institutions;
--create central repository and common standards for reporting on STEM inclusion and implementation program impact for the state.
Approximately 340 individuals serving a broad cross-section of California's K-12, higher education, public, private and non-profit constituencies will participate in 2 ½ days of intense dialogue on topics such as data and research, successful implementations and sustainable networks for collaboration and sharing. The conference will be held in Spring 2017.
DATE:
-
TEAM MEMBERS:
Michael DenninSarah Eichhorn
resourceprojectProfessional Development, Conferences, and Networks
The University of Wisconsin-Madison, Iowa State University, University of Pittsburgh, University of Texas at El Paso, Michigan State University, University of Georgia and University of California, Los Angeles will lead this Design and Development Launch Pilot to build the foundation for a national alliance that will prepare a new national STEM faculty, spanning all of post-secondary education, able to use evidence-based teaching, mentoring and advising practices that yield greater learning, persistence and completion of women and historically underrepresented minorities (URM) undergraduates in STEM. This project was created by this group of institutions, who are members of the Center for the Integration of Research, Teaching and Learning (CIRTL), in response to the Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program solicitation (NSF 16-544). The INCLUDES program is a comprehensive national initiative designed to enhance U.S. leadership in science, technology, engineering and mathematics (STEM) discoveries and innovations focused on NSF's commitment to diversity, inclusion, and broadening participation in these fields. The INCLUDES Design and Development Launch Pilots represent bold, innovative ways for solving a broadening participation challenge in STEM.
The full participation of all of America's STEM talent is critical to the advancement of science and engineering for national security, health and prosperity. Our nation is advancing knowledge and practices to address a STEM achievement and the graduation gap between undergraduate STEM students who are women and men, and between those who are URMs and non-URMs. At the same time U.S. universities and colleges struggle to recruit, retain and promote a diverse STEM graduate student body, and a diverse STEM faculty, who serve as role models and academic leaders for URM and female students to learn from, to work with and to emulate. This project, the CIRTL INCLUDES - Toward an Alliance to Prepare a National Faculty for Broadening Success of Underrepresented 2-Year and 4-Year STEM Students, has the potential to advance a national network of organizations to improve the success of future STEM faculty who will educate a diverse undergraduate body and contribute to the learning, retention and graduation of women and URMs in STEM fields.
The collaborating CIRTL universities will work closely with multiple organizations to address key goals, including Achieving the Dream, Advanced Technological Education Central, the American Association for the Advancement of Science, the American Mathematical Society of Two-Year Colleges, the American Physical Society, the American Society for Engineering Education, the Association of American Universities, the Association of Public and Land-Grant Universities, the Council of Graduate Schools, the Council for the Study of Community Colleges, Excelencia in Education, the Infrastructure for Broadening Participation in STEM, the Louis Stokes Midwest Center for Excellence, the Math Alliance, the National Institute for Staff and Organizational Development, the National Research Mentoring Network, the Partnership for Undergraduate Life Science Education, the Southern Regional Education Board, the Summer Institutes on Scientific Teaching, and the Women in Engineering Programs and Advocates Network. Together, this extensive collaborative network will three goals: (1) To deepen the preparation of future STEM faculty in teaching, mentoring and advising practices that promote the success of undergraduates who are women and URMs; (2) To expand and strengthen faculty preparation specifically for 2-year colleges; and (3) To target the preparation of future STEM faculty who are members of underrepresented groups for effective teaching and mentoring, contributing to their early-career success. The seven universities who are partnering to lead this project will work to: (1) Form active partnerships and national coalitions for each of the three goals; (2) Employ a collective impact framework for each goal team and the entire alliance, ensuring common agendas, shared metrics, mutually reinforcing activities and an integrated process using data improvement cycles; and (3) Achieve pilot outcomes that position the alliance for future work.
DATE:
-
TEAM MEMBERS:
Robert MathieuRenetta TullKatherine BarnicleCraig OgilvieLeslie GonzalesErin SandersJudy MiltonMary Besterfield-SacreBenjamin FloresOcegueda Isela
Mathematics is the foundation of many STEM fields and success in mathematics is a catalyst for success in other scientific disciplines. Increasing the participation of women and other under-represented groups in the mathematics profession builds human capital that produces a diverse pool of problem solvers in business and industry, research mathematicians, faculty at all levels, and role models for the next generation. Existing support and enrichment programs have targeted women in mathematics at different stages in their undergraduate and graduate education, with different strategies to building community, creating a sense of belonging, and promoting a growth mind set. These strategies challenge some of the most common obstacles to success, including isolation, stereotype threat, not committing to mathematics early enough, and imposter syndrome. Acknowledging the diversity among women in terms of socio-economic background and educational background, this project proposes to examine the effectiveness of these programs through the lens of two primary questions: (1) Which elements of these programs are most critical in the success of women, as a function of their position along these distinct diversity axes?, and (2) which features of these programs are most effective as a function of the stage of the participant's career? These questions are guided by the rationale that a better understanding of, and improved pathways by, which programs recruit and retain undergraduate and graduate women in mathematics has the strong potential to increase the representation of women among mathematics PhDs nationwide.
This project seeks to increase and diversify the number of professional mathematicians in the United States by identifying and proliferating best practices and known mechanisms for increasing the success of women in mathematics graduate programs, particularly women from under-represented groups. The PIs on this proposal, all of whom are leaders of initiatives that have been active for nearly two decades, will work with experts in management, data collection and reporting, and communications to address the following three challenges: (1) develop a common system of measuring the effectiveness of each element in these initiatives; (2) develop a process for effective, collective decision making; and (3) create connections between existing activities and resources. This project is both exploratory research and effectiveness research. The project team first will explore the contextual factors that serve to support or inhibit female pursuit of mathematics doctorates by interviewing a variety of women who were undergraduate mathematics majors in the past, as well as current professional mathematicians. They then will use this information to better understand the most effective features of various current and past initiatives that are trying to increase the participation of women in advanced mathematics. A key stakeholder meeting will develop a process for effective, collective decision-making, to utilize what the project team learns from the interviews. The leadership team will develop a website with discussion board and social media components to highlight best practices and facilitate a virtual community for women interested in mathematics. Finally, a distillation of program elements and their targeted effectiveness will inform the selection of interconnected activities to test on a scalable model. These prototypes will be implemented at several sites chosen to represent a diversity of constituencies and local support infrastructure.
DATE:
-
TEAM MEMBERS:
Judy WalkerAmi RadunskayaRuth HaasDeanna Haunsperger
resourceprojectProfessional Development, Conferences, and Networks
This collaboration between two Historically Black Colleges and Universities (HBCUs) will form a networked improvement community located within the Piedmont Region of North Carolina. In close partnership with community colleges and civic organizations, the project will reach families and students that lead to broader participation of underrepresented groups in science, technology, engineering, and mathematics (STEM) fields. The overall goal is to build and sustain a scalable, inquiry-based network with the purpose of increasing the academic success of underrepresented ethnic minorities and women in the STEM continuum. By engaging in culturally relevant socio-environmental frameworks, project outcomes will positively impact student retention, knowledge, and quantitative skills in STEM across socio-economic divides and STEM disciplines.
The Launch Pilot phase will focus on evidence-based teaching and learning approaches for middle school students. The core structure of the network will serve as a platform to launch and guide other age- and level-specific educational instruction, research, and assessment initiatives. Student understanding of the nature of science will be enhanced by adapting structure, behavior, and function (SBF) theory and system thinking hierarchical (STH) models. Ultimately, the network will represent a driver for social innovation that positively impacts broadening participation in STEM.
The Association of Public and Land-Grant Universities (APLU) will lead this Design and Development Launch Pilot to conduct activities aimed to increase the number of STEM faculty at APLU member universities from underrepresented and traditionally underserved groups: Women, historically underrepresented minorities (URM), persons with disabilities (PWD), and people from low socioeconomic backgrounds. This project was created in response to the Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science (NSF INCLUDES) program solicitation (NSF 16-544). The INCLUDES program is a comprehensive national initiative designed to enhance U.S. leadership in science, technology, engineering and mathematics (STEM) discoveries and innovations focused on NSF's commitment to diversity, inclusion, and broadening participation in these fields. The INCLUDES Design and Development Launch Pilots represent bold, innovative ways for solving a broadening participation challenge in STEM.
The full participation of all of America's STEM talent is critical to the advancement of science and engineering for national security, health and prosperity. Our nation is advancing knowledge and practices to address a STEM achievement and the graduation gap between postsecondary STEM students who are women, URM, PWD, and persons from low socioeconomic backgrounds and males, non-URM, non-PWD, and persons from middle and upper socioeconomic backgrounds. At the same time U.S. universities and colleges struggle to recruit, retain and promote a diverse STEM faculty as role models and academic leaders for historically underrepresented and traditionally underserved students to learn from, to work with and to emulate. Recent NSF reports indicate that URM STEM associate and full professors occupy 8% of the senior faculty positions at all 4-year colleges and universities and about 6% of these positions at the nation's most research-intensive institutions. The APLU INCLUDES: A Collective Impact Approach to Broadening Participation in the STEM Professoriate has the potential to advance a national network of organizations to improve the representation of women, URMs, PWDs and persons from low socioeconomic backgrounds in STEM faculty positions, eventually providing URM STEM role models to STEM undergraduate and graduate students at postsecondary academic institutions across the Nation.
APLU will work closely with multiple organizations to address key objectives, including the American Association for the Advancement of Science, the Center for the Integration of Research, Teaching and Learning, the Collaborative on Academic Careers in Higher Education, the Committee on Institutional Cooperation (recently renamed the Big Ten Academic Alliance), the Council of Graduate Schools, the Florida Education Fund's McKnight Doctoral Fellowship Program, Southern Regional Education Board State Doctoral Scholars Program and the University of California's Office of the President. Together this network plans to connect APLU member institutions and experts to (1) develop and test a set of diagnostic tools and practices for recruiting, hiring, retaining and supporting faculty, to (2) identify a set of institutional activities to increase participation along STEM pathways toward the professoriate, to engage a group of institutions to collectively implement one or more of the activities, and to (3) evaluate the adequacy and coverage current data sources and metrics available to track students from entry into postsecondary education through the professoriate.
DATE:
-
TEAM MEMBERS:
Howard GobsteinAlan MabeTravis YorkChristine KellerKimberly Griffin
resourceprojectProfessional Development, Conferences, and Networks
Jobs are growing most rapidly in areas that require STEM knowledge, causing business leaders to seek skilled American workers now and in the near future. Increase in the number of students pursuing engineering degrees is taking place but the percentages of underrepresented students in the engineering pipeline remains low. To address the challenge of increasing the participation of underrepresented groups in engineering, the National Society of Black Engineers, the American Indian Science and Engineering Society, the Society of Hispanic Professional Engineers, and the Society of Women Engineers have formed the 50K Coalition, a collaborative of over 40 organizations committed to increasing the number of bachelors degrees awarded to women and minorities from 30,000 annually to 50,000 by 2025, a 66% increase. The 50K Coalition is using the Collective Impact framework to develop an evidence-based approach that drives management decision-making, improvements, sharing of information, and collective action to achieve success. The first convening of the 50K Coalition in April, 2016, brought together 83 leaders of the engineering community representing 13 professional societies with over 700,000 members, deans of engineering, minority engineering and women in engineering administrators from 11 leading colleges of engineering, and corporate partners representing six global industries. Consensus was reached on the following Common Agenda items: 1.) Undergraduate support and retention; 2.) Public awareness and marketing; 3.) K-12 support; 4.) Community College linkages; 5.) Culture and climate. The Coalition will encourage member organizations to develop new programs and scale existing programs to reach the goal.
The Coalition will use shared metrics to track progress: AP® Calculus completion and high school graduation rates; undergraduate freshmen retention rates; community college transfer rates and number of engineering degrees awarded. The 50K Coalition will develop the other elements of the Collective Impact framework: Infrastructure and effective decision-making processes that will become the backbone organization with a focus on data management, communications and dissemination; a system of continuous communication including Basecamp, website, the annual Engineering Scorecard, WebEx hosted meetings and convenings; and mutually reinforcing activities such as programs, courses, seminars, webinars, workshops, promotional campaigns, policy initiatives, and institutional capacity building efforts. The National Academy of Sciences study, Expanding Underrepresented Minority Participation: America's Science and Technology Talent at the Crossroads recommended that professional associations make recruitment and retention of underrepresented groups an organizational goal and implement programs designed to reach that goal by working with their membership, academic institutions and funding agencies on new initiatives. While these types of organizations work together now in a variety of ways, the relationships are one-on-one. The 50K Coalition brings together, for the first time professional societies, engineering schools, and industry to consider what mutually reinforcing activities can most effectively encourage students from underrepresented groups to complete calculus and graduate from 4-year engineering programs.
DATE:
-
TEAM MEMBERS:
Karl ReidBarry CorderoSarah EcohawkKaren Horting
Because of the siloed nature of formal educational curricula, students who opt out of STEM coursework, for whatever reason, lose the opportunity to engage with the domain of science almost entirely, thereby closing the door to the STEM workforce pipeline. This disproportionately impacts students of color and women. This project advances an alliance that consists of a consortium of community-engaged partners, including university and k-12 educational agencies, community colleges, community organizations, cultural institutions and local businesses. The project built around this alliance will leverage interdisciplinary spaces in the curriculum, particularly the humanities and social sciences, across academic levels, as a forum for integrating and applying STEM to bear on the practical, social, economic and political issues of modern life. The PIs establish a physical Community STEM Center as an anchoring institution for STEM engagement. This Center will be situated within the community that the alliance serves, bringing STEM opportunities and engagement to students instead of asking them to come where STEM education is currently provided. The activities enacted through the Community STEM Center will focus on enduring problems experienced by the communities, where students, community residents, teachers, and experts from higher education, industry and other community-based entities can come together to work on understanding them and developing evidenced centered advocacy as a means for addressing them. To facilitate the work at the Community STEM Center, the project creates a Community Ambassadors Program (CAP), leveraging participation across alliance members in partnership with the community. This Design and Development Launch Pilot will cultivate the necessary knowledgebase to develop a scalable model for implementation across diverse urban communities.
Technical Summary
This Design and Development Launch Pilot focuses on shifting the narrative of STEM education away from a solitary focus on formalized educational experiences and targets STEM content. This project develops and facilitates a parallel set of activities designed to engage under-represented students in learning how and why STEM is relevant to their lives, and approached through new and non-traditional educational dimensions. The five main objectives of this proposed pilot are to: (1) Develop a pilot alliance of community-engaged partners, including university and k-12 educational agencies, community colleges, community organizations, cultural institutions and industry;(2)Establish a physical Community STEM Advocacy Center as an anchoring institution for change embedded within the community that the pilot alliance serves; (3) Leverage interdisciplinary spaces in curricula, across academic levels, particularly the humanities and social sciences, as a forum for integrating and applying STEM to bear on the practical, social, economic and political issues of modern life; (4) Create a Community Ambassadors Program (CAP), leveraging participation across higher education pilot alliance members in partnership with the community; and (5)Conduct an evaluation of project initiatives and research regarding the usability and feasibility of a systemic approach to developing community-based, interdisciplinary pathways to broaden STEM participation pathways. Efforts to examine the impact of this community-based, interdisciplinary approach concentrates on the proximal outcomes related to STEM interest, self-efficacy and identity. Data will be collected in pre/post format across our three constituent samples: 1) Community STEM Advocacy Center participants; 2) k-12 students; and, 3) postsecondary students. Analysis of data will be conducted through MANCOVAs to account for potential co-variation among construct scores. Qualitative data will also be collected to contextualize findings and enable the development of a rich case study. At least two observations will be conducted in the Community STEM Advocacy Center and the two classroom implementations to document engagement, participant interactions and level of STEM content.
DATE:
-
TEAM MEMBERS:
Kimberly LawlessDonald WinkLudwig Carlos NitscheAixa AlfonsoJeremiah Abiade
Currently, many young people - especially girls and youth of color - lose confidence and interest in science, technology, engineering and math (STEM) pathways due to a perceived disconnect between their own identity and STEM fields. To address this challenge, Twin Cities PBS (TPT) is implementing SciGirls CONNECT2. This three-year Research in Service to Practice award examines how gender equitable and culturally responsive teaching strategies influence middle school girls' confidence, interest and motivation around STEM studies, and their choices around STEM careers. A set of research-based strategies, called the SciGirls Seven, are currently employed in SciGirls, an NSF-funded informal STEM educational outreach program serving 125+ educational partner organizations nationwide. The goal is to update and enrich the SciGirls Seven, providing educators with a critical, current, and more effective resource to motivate girls in STEM studies and careers. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments.
Florida State University will conduct a formal research study investigating the hypothesis that STEM programs that use gender equitable and culturally responsive strategies contribute to girls' positive STEM identity development, including their sense of self-efficacy, persistence and aspirations around future STEM careers. This research will include a literature review and a study of girls' STEM identity creation. The mixed methods study will include quantitative and qualitative data collection and analysis measuring changes in students' STEM identity and teachers' confidence in STEM teaching. The quantitative data will come from the student, parent and teacher pre/post surveys. The qualitative research will be conducted via case studies at four sites and the qualitative data will include observations, focus groups and interviews. Girls at all partner sites will create videos that will allow the research team to gather additional insight. The independent firm Knight Williams, Inc. will conduct the project's external evaluation.
The project will work with a subset of 16 current SciGirls partners. These geographically diverse partners will reach youth in all-girls and co-ed informal STEM education programs in a variety of settings. More than half serve Hispanic or other minority populations. The updated strategies will be disseminated to the 2,500 educators within the SciGirls partner network and the 18,800 STEM education organizations of the National Girls Collaborative Project (NGCP) network. Dissemination of the strategies and literature review will focus on the informal STEM education field through publications and presentations, posts at PBS LearningMedia, a free online space reaching 1.5 million teachers and educators.
The National Girls Collaborative Project (NGCP) seeks to maximize access to shared resources within projects and with public and private sector organizations and institutions interested in expanding girls’ participation in science, technology, engineering, and mathematics (STEM). Funded primarily by the National Science Foundation, the NGCP is a robust national network of more than 3,000 girl-serving STEM organizations. Currently, 31 Collaboratives, serving 40 states, facilitate collaboration between more than 12,800 organizations who serve more than 7.7 million girls and 4.4 million boys. The NGCP occupies a unique role in the STEM community because it facilitates collaboration with all stakeholders who benefit from increasing diversity and engagement of women in STEM. These stakeholders form Regional Collaboratives, who are connected to local girl-serving STEM programs. Regional Collaboratives are led by leadership teams and advisory boards with representatives from K-12 education, higher education, community-based organizations, professional organizations, and industry. NGCP strengthens the capacity of girl-serving STEM projects by facilitating collaboration among programs and organizations and by sharing promising practice research, program models, and products through webinars, collaboration training, and institutes. This is accomplished through a tested comprehensive program of change that uses collaboration to expand and strengthen STEM-related opportunities for girls and women. In each replication state, the NGCP model creates a network of professionals, researchers, and practitioners, facilitating collaboration within this network, and delivering high-quality research-based professional development. Participating programs can also receive mini-grant funding to develop collaborative STEM-focused projects. To date, over 27,000 participants have been served in 241 mini-grant projects, and over 17,000 practitioners have been served through in-person events and webinars. The NGCP’s collaborative model changes the way practitioners and educators work to advance girls’ participation in STEM. It facilitates the development of practitioners in their knowledge of good gender equitable educational practices, awareness of the role of K-12 education in STEM workforce development, and mutual support of peers locally and across the United States.