Summary brief describing findings from summative evaluation for the Marcellus Citizen Science Network component of the Marcellus Matters: EASE project.
Summative evaluation of one of four pieces of the Marcellus Matters: EASE project. This study examined the effectiveness of a program developed to immerse adult learners in the processes of scientific research by teaching participants to locate and report orphan and abandoned natural gas wells.
The Sustainability Teams Empower and Amplify Membership in STEM (S-TEAMS), an NSF INCLUDES Design and Development Launch Pilot project, will tackle the problem of persistent underrepresentation by low-income, minority, and women students in STEM disciplines and careers through transdisciplinary teamwork. As science is increasingly done in teams, collaborations bring diversity to research. Diverse interactions can support critical thinking, problem-solving, and is a priority among STEM disciplines. By exploring a set of individual contributors that can be effect change through collective impact, this project will explore alternative approaches to broadly enhance diversity in STEM, such as sense of community and perceived program benefit. The S-TEAMS project relies on the use of sustainability as the organizing frame for the deployment of learning communities (teams) that engage deeply with active learning. Studies on the issue of underrepresentation often cite a feeling of isolation and lack of academically supportive networks with other students like themselves as major reasons for a disinclination to pursue education and careers in STEM, even as the numbers of underrepresented groups are increasing in colleges and universities across the country. The growth of sustainability science provides an excellent opportunity to include students from underrepresented groups in supportive teams working together on problems that require expertise in multiple disciplines. Participating students will develop professional skills and strengthen STEM- and sustainability-specific skills through real-world experience in problem solving and team science. Ultimately this project is expected to help increase the number of qualified professionals in the field of sustainability and the number of minorities in the STEM professions.
While there is certainly a clear need to improve engagement and retention of underrepresented groups across the entire spectrum of STEM education - from K-12 through graduate education, and on through career choices - the explicit focus here is on the undergraduate piece of this critical issue. This approach to teamwork makes STEM socialization integral to the active learning process. Five-member transdisciplinary teams, from disciplines such as biology, chemistry, computer and information sciences, geography, geology, mathematics, physics, and sustainability science, will work together for ten weeks in summer 2018 on real-world projects with corporations, government organizations, and nongovernment organizations. Sustainability teams with low participation by underrepresented groups will be compared to those with high representation to gather insights regarding individual and collective engagement, productivity, and ongoing interest in STEM. Such insights will be used to scale up the effort through partnership with New Jersey Higher Education Partnership for Sustainability (NJHEPS).
DATE:
-
TEAM MEMBERS:
Amy TuiningaAshwani VasishthPankaj Lai
Physical science and engineering remain the least diverse of all STEM fields---with regard to women, underrepresented minorities, and persons with disabilities---across all levels of STEM education and training. SCI-STEPS is an NSF INCLUDES Design and Development Launch Pilot that will address this persistent challenge by developing a complete end-to-end pipeline (or system of pathways) from the beginning of college to the PhD, and then into the workforce. Many isolated efforts to broaden participation have shown promise, but they have not produced big enough impact. SCI-STEPS represents a concerted set of coordinated interventions---consciously facilitated, systemically linked, and purposefully disseminated. SCI-STEPS represents a broad regional network among major research universities, Historically Black Colleges and Universities, comprehensive universities, community colleges, national labs, and major scientific organizations. The goal of the network is to ensure that underrepresented individuals in the physical sciences and engineering can get from their starting point in STEM higher education---freshmen at 2-year or 4-year college---through the higher education pathways leading to an appropriate terminal degree and employment in the STEM workforce.
Women, underrepresented minorities, and persons with disabilities collectively represent the majority of college-age individuals entering higher education with an expressed interest in physical science and engineering. A growing body of research indicates that academic and social integration may be even more influential than academic abilities for retention of students. Thus, interventions aimed at stemming the losses of these individuals must ultimately be aimed at changing the system---including unwelcoming institutional climates, racial/ethnic/gender stereotyping, a lack of mentors with whom to identify, and evaluation methods that emphasize conformity over individual capabilities---rather than changing the individual. The SCI-STEPS pilot focuses effort on institutional readiness for implementation of best practice interventions at four key junctures: (i) college freshman to sophomore; (ii) undergraduate to graduate; (iii) PhD to postdoc; and (iv) postdoc to workforce.The pilot will proceed in three steps: (1) a planning phase, (2) development of an initial end-to-end pathways model with four Juncture Transition teams, and (3) scale-up of the SCI-STEPS "network of networks" with all initial partners. By addressing these objectives through a collective impact framework and embedded research, this pilot will demonstrate how best-practice interventions at each pathway juncture can be dovetailed and scaled up across a broad range of institutional types and across a large but distinct geographical area. Addressing these objectives will thus also serve to advance Broadening Participation efforts at a national scale, by suggesting the forms of institutional partnerships and best-practices that may inform other alliances in other STEM disciplines and/or different regional areas.
DATE:
-
TEAM MEMBERS:
Keivan StassunNicole JosephKelly Holley-BockelmannWilliam RobinsonRoger Chalkley
The most important consideration in evaluating chemistry outreach efforts is how to best use the evaluation to serve project needs. Evaluation should be about making programs more effective—at communicating ideas, changing attitudes, inspiring action, or reaching wider audiences, for example. A well-conducted evaluation typically contributes to the quality of a project by helping its leaders better define their goals, identify important milestones and indicators of success, and use evidence to support ongoing improvements. At its best, evaluation is an integral part of project design and
The National Research Council’s (NRC) Board on Chemical Sciences and Technology (BCST) and Board on Science Education (BOSE) received funding from the National Science Foundation (NSF) to develop a framework for effective chemistry communication, outreach, and education in informal settings, with the ultimate goal of increasing the effectiveness of such efforts in engaging the public with chemistry. BCST and BOSE are assembling a committee of experts to execute this work. To support their efforts, BCST and BOSE also commissioned this landscape study, which serves as background for the
Lack of diversity in science and engineering education has contributed to significant inequality in a workforce that is responsible for addressing today's grand challenges. Broadening participation in these fields will promote the progress of science and advance national health, prosperity and welfare, as well as secure the national defense; however, students from underrepresented groups, including women, report different experiences than the majority of students, even within the same fields. These distinctions are not caused by the students' ability, but rather by insufficient aspiration, confidence, mentorship, instructional methods, and connection and relevance to their cultural identity. The long-term vision of this project is to amplify the impact of a successful broadening participation model at the University of Maine, the Stormwater Research Management Team (SMART). This program trains students and mentors in using science and engineering skills and technology to research water quality in their local watershed. Students engage in numerous science and technology fields: engineering design, data acquisition, analysis and visualization, chemistry, environmental science, biology, and information technology. Students also connect with a diversity of professionals in water and engineering in government, private firms and non-profits. SMART has augmented the traditional science and engineering classroom by engaging students in guided mentored apprenticeships that address community problems.
Technical
This pilot project will form a collaborative and define a strategic plan for scale-up to a national alliance to increase the long-term success rate of underrepresented minority students in science, engineering, and related fields. The collaborative of multiple and varied organizations will align to collectively contribute time and resources to a pre-college educational pathway. There are countless isolated programs that offer short-term interventions for underrepresented and minority students; however, there is lack of organizational coordination for aligning current program offerings, sharing best practices, research results or program outcomes along the education to workforce pathway. The collaborative activities will focus on the transition grades (e.g., 4-5, 8, and high school) and emphasize relationships among skills, confidence, culture and future careers. Collaborative partners will establish a centralized infrastructure in each location to coordinate recruiting of invested community leaders, educators, and parents, around a common agenda by designing, deploying and continually assessing a stormwater-themed project that addresses their location and demographic specific needs. This collaborative community will consist of higher education faculty and students, K-12 students, their caregivers, mentors, educators, stormwater districts, state and national environmental protection agencies, departments of education, and other for-profit and non-profit organizations. The collaborative will address the need for research on mechanisms for change, collaboration, and negotiation regarding the greater participation of under-represented groups in the science and technology workforce.
DATE:
-
TEAM MEMBERS:
Mohamed MusaviVenkat BhethanabotlaCary JamesVemitra WhiteLola Brown
resourceprojectProfessional Development, Conferences, and Networks
Physics awards smaller percentages of PhDs to women (19%) and underrepresented ethnic and racial minorities (7%) than any other field in the sciences, and underrepresentation is especially pronounced at selective universities. As global competition for scientific talent heats up and US demographics shift, cultivating a robust domestic workforce is critical to US technological leadership. We seek to build on the successful American Physical Society Bridge Program (apsbridgeprogram.org) by transforming physics graduate education to fully support the inclusion of women and ethnic and racial minorities. Our vision is to create a national network of disciplinary colleagues, expert researchers, and representatives from professional associations who will develop and build evidence-based knowledge of effective practices for recruitment, admissions, and retention of women and underrepresented ethnic and racial minorities. This pilot project will include six large, highly selective physics graduate programs to demonstrate and map out a plan for a discipline-wide effort. The pilot focuses on improving admissions practices, because this strategy promises immediate and measurable impact backed by extant research. The pilot will also take exploratory steps to develop scalable recruitment and retention strategies. To refine interventions, we will conduct research to identify and understand demographically-based loss points of students in graduate physics programs and to understand how network participation facilitates change. The project will also establish connections with other STEM disciplines, beginning with mathematics and chemistry, to explore expanding these efforts.
This project is grounded in research on diversity in graduate education, organizational learning, and the resources of networks to catalyze cultural change. The project team includes expertise in institutional change, graduate admissions, student success, diverse and inclusive environments, and social science research. The pilot advances a novel research agenda on inclusion in STEM by addressing recruitment, admissions, and retention in physics graduate education as interconnected challenges of faculty learning, professional networks, and disciplinary cultural change. Physics graduate programs will report admissions data and common metrics, and will document changes resulting from project activities. Faculty will be trained on holistic admissions and diversity in selection processes, and be guided in the use of inclusive admissions practices. An external evaluator will examine project effectiveness and readiness for scaling to an Alliance phase project.
DATE:
-
TEAM MEMBERS:
Monica PlischTheodore HodappJulie PosseltGeraldine CochranCasey Miller
Chemistry is an important and widely relevant field of science. However, when compared with other STEM content areas, chemistry is under-represented in U.S. science museums and other informal educational environments. This project will build, and build knowledge about, innovative approaches to delivering informal science learning activities in chemistry. The project will not only increase public interest and understanding of chemistry but also increase public perception of chemistry's relevance and increase the public's self-efficacy with respect to chemistry. This project outcomes will include a guide for practitioners along with activity materials that will be packaged into a kit, distributed, and replicated for use by informal science educators, chemists, and chemistry students at 250 sites across the U.S. The project team will reach out to organizations that serve diverse audiences and diverse geographic locations, including organizations in rural and inner-city areas. The kits will provide guidance on engaging girls, people with various abilities, Spanish speakers, and other diverse audiences, and include materials in Spanish. Written guides, training videos, and training slides will be included to support training in science communication in general, as well as chemistry in particular. This project is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
This project will take an innovative approach to develop informal educational activities and materials about chemistry. Rather than starting with content goals, the project will start with a theoretical framework drawn from research about affecting attitudes about science related to interest, relevance, and self-efficacy. A design-based research approach (DBR) will be used to apply that framework to the development of hands-on educational activities about chemistry, while also testing and modifying the framework itself. (DBR blends empirical educational research with the theory-driven design of learning environments.) Existing or new educational activities that appear to embody key characteristics defined in the framework will be tested with public audiences for their impact on visitors. Researchers and educators will determine how different characteristics of the educational activities defined in the framework affect the outcomes. The activities will be modified and tested iteratively until the investigators achieve close alignment between framework and impacts.. The project team will continue the design-based research approach both to examine groups of activities in which synergies can have impacts beyond single interactions as well as to examine varied ways of training facilitators who can also significantly affect outcomes. In this way, the project will generate knowledge about how kits of hands-on informal learning activities can stimulate attitudes of interest, relevance, and self-efficacy with respect to the neglected field of chemistry. The project teams will broadly disseminate project outcomes within the educational research, science and informal Science, Technology, Engineering and Mathematics (STEM) education communities. While this project will focus on chemistry, the strategies it will develop and test through a design-based research process will provide valuable insight into effective approaches for informal STEM education more broadly.
In this chapter we present the ways in which institutional cultural differences impact the development and implementation of learning activities in informal settings. Five university-based centers for the study of chemistry worked with informal learning professionals to re-envision educational and public outreach activities about science. The projects were part of a broader effort to catalyze new thinking and innovation in informal education and chemistry centers. The set of projects illustrates the broad possibilities for informal learning settings, with projects targeting diverse audiences
In the name of God is the heading chosen by some researchers from a Middle Eastern country for their posters in an international conference on chemistry which has recently been held in Paris. This powerful message preceded the results of the researchers' work on the morphology, molecular structure, as well as the physical, chemical and mechanical properties of advanced polymeric materials. It was an unexpected statement, an unusual message, though certainly not an unprecedented one. It had nonetheless a striking effect in the context of a scientific conference attended by thousands of people
Chemistry plays a critical role in daily life, impacting areas such as medicine and health, consumer products, energy production, the ecosystem, and many other areas. Communicating about chemistry in informal environments has the potential to raise public interest and understanding of chemistry around the world. However, the chemistry community lacks a cohesive, evidence-based guide for designing effective communication activities. This report is organized into two sections. Part A: The Evidence Base for Enhanced Communication summarizes evidence from communications, informal learning, and