Summary brief describing findings from summative evaluation for the Marcellus Citizen Science Network component of the Marcellus Matters: EASE project.
Summative evaluation of one of four pieces of the Marcellus Matters: EASE project. This study examined the effectiveness of a program developed to immerse adult learners in the processes of scientific research by teaching participants to locate and report orphan and abandoned natural gas wells.
RMC Research designed evaluation activities to provide formative and summative feedback to the Hubbard Brook Research Foundation (HBRF) on their NSF Pathways project, Forest Science Dialogues (FSD). FSD consists of a plan to engage with scientists at the Hubbard Brook Ecosystem Study and with the surrounding community using the Hubbard Brook Roundtable dialogue process in order to facilitate mutual learning. The purpose of this engagement was to increase public knowledge, understanding, and awareness of ecosystem science in the Northern Forest in order to enrich local dialogue surrounding
This poster was presented at ASTC 2016 in Tampa, Florida. Climate change can be abstract to visitors, but seeing, touching and smelling permafrost can make it seem more real. This poster shares lessons about bringing an ISE program to rural Alaska, and how this University & Museum partnership leverages real objects from frozen ground to engage child and adult learners alike in the emotions of climate change.
The lack of equitable access to science learning for marginalized groups is now a significant concern in the science education community (Bell et al. 2009). In our commitment to addressing these concerns, we (the HERP Project staff) have spent four years exploring different ways to increase diverse student participation in our informal science programs called herpetology research experiences (HREs). We wanted the demographics of participants to mirror the racial, ethnic, cultural, linguistic, and socioeconomic demographics of the areas where our HREs are held. To achieve this, project staff
Developing and maintaining a diverse, innovative workforce in the fields of science, technology, engineering and math (known as STEM) is critical to American competitiveness in the world, but national surveys report a current and future shortage of highly qualified STEM professionals in the US. One problem creating this shortage is that more than half of all college students who declare a major in STEM fields drop out or change their majors in the first two years of their post-secondary education. This problem is particularly acute for first generation college students. If we could increase the STEM degree completion rate by just 25%, we would make up 75% of the additional workforce needed over the next decade.
Our project aims to increase the STEM persistence of first generation college students and focuses on rural students in West Virginia. Project partners including scientists from National Labs, college faculty, local school system staff, informal educators, State Department of Education officials, and West Virginia college students will collaborate to develop summer and academic year activities that support young undergraduates majoring in STEM. Activities that we will pilot include early opportunities to do science research, academic year courses that develop science, math and communication skills, and the formation of Hometown STEM Ambassadors; undergraduate STEM students that encourage younger students back in their hometown schools. We will study the impact of these activities on students' persistence in STEM majors.
Our Project is called FIRST TWO: Improving STEM Persistence in the First Two Years of College (FIRST TWO).
Technical Details:
During the Development Launch Project, partners will create and pilot components of two courses that will confer college credit to students in two and four year schools. Each course will have as its center piece a research and development internship. By the end of the Project Development Pilot, FIRST TWO course modules will be integrated into courses the State, and be transferable between community colleges and four-year schools.
An innovative component of FIRST TWO is the creation of Hometown STEM ambassadors--students who participate in both courses will be prepared to mentor their peers, and also conduct outreach in their home school districts. They will make presentations to hometown K-12 students, and will discuss STEM college readiness issues with local education leaders. We believe reconnecting post-secondary students with their home communities and providing place-based relevance to their STEM education will have a positive impact on their persistence, as well as the added benefit of encouraging K-12 students to envision themselves as future STEM professionals.
FIRST TWO will:
- integrate early experience in STEM internships, online communities of practice and STEM skills development into a discovery-based "principles of research and development" college seminar for first year students;
- sustain engagement through a second service learning course, called STEM Leadership that will develop communication and mentoring skills and produce peer mentors who will mentor younger students, join in the efforts to change the STEM education experience at their schools, and conduct outreach in their hometown communities during the students? second year and third years.
- secure state-wide adoption and transferability of these courses, or course materials, and ultimately scale the program across the Appalachian region and to other states with large rural student populations.
- collaborate with National Labs to determine the feasibility of a National STEM Persistence Alliance partnering National Lab internship programs with 2 and 4-year schools who serve FGC students.
Finally, there are many studies that inquire into the factors that correlate with post-secondary retention in general, and with STEM attrition specifically but few that focus on rural students. FIRST TWO will fully articulate a rigorous educational research project aimed at advancing understanding of the factors affecting rural students' entry into and persistence in STEM career pathways. This research will study the impact FIRST TWO program components make on rural FGC students' persistence in STEM majors. Instruments will be developed and validated that test the components proposed in FIRST TWO interventions. As we scale the program to a larger Alliance, so will the research study scale, providing a unique opportunity to inform the education community about the rural students' experience.
DATE:
-
TEAM MEMBERS:
Sue HeatherlyKaren ONeilErica Harvey
One common barrier to STEM engagement by underserved and underrepresented communities is a feeling of disconnection from mainstream science. This project will involve citizen scientists in the collection, mapping, and interpretation of data from their local area with an eye to increasing STEM engagement in underrepresented communities. The idea behind this is that science needs to start at home, and be both accessible and inclusive. To facilitate this increased participation, the project will develop a network of stakeholders with interests in the science of coastal environments. Stakeholders will include members of coastal communities, academic and agency scientists, and citizen science groups, who will collectively and collaboratively create a web-based system to collect and view the collected and analyzed environmental information. Broader impacts include addressing the STEM barriers to those who reside in the coastal environment but who are underrepresented in STEM education, vocations and policy-making. These include tribal communities (racial and ethnic inclusion), fishery communities (inclusion of communities of practice), and rural communities without direct access to colleges or universities. This project will create a physical, a social, and a virtual, environment where all participants have an equal footing in the processes of "doing science" - the Coastal Almanac. The Almanac is simultaneously a network of individuals and organizations, and a web-based repository of coastal data collected through the auspices of the network. During the testing phase, the researchers will implement the "rules of engagement" through multiple interaction pathways in the growing Coastal Almanac network: increases in rigorous citizen science, development of specific community-scientist partnerships to collect and/or use Almanac data, development of K-12 programs to collect and/or use Almanac data. The proposed work will significantly scale up citizen science and community-based science programs on the West Coast, broadening participation by targeting members of coastal communities with limited access to mainstream science, including participants from non-STEM vocations, and Native Americans. The innovation of the Coastal Almanac is in allowing the process of deepening involvement in science, and through that process increasing agency of community members to be bona fide members of the science team, to evolve organically, in the manner dictated by community members and the situation, rather than a priori by the project team and mainstream science. The project has the potential in the long-term to increase participation in marine science education, workforce, and policy-making by underrepresented groups resident in the coastal environment. Contributions by project citizen scientists will also provide valuable data to mainstream science and to resource management efforts.
DATE:
-
TEAM MEMBERS:
Julia ParrishMarco HatchSelina Heppell
A frequently missing element in environmental education programs is a concerted effort by communities, organizations, government, and academic stakeholders to build meaningful partnerships and cultivate informal science learning opportunities via public participation in environmental research. This collaborative approach not only makes scientific information more readily available, it also engages community members in the processes of scientific inquiry, synthesis, data interpretation, and the translation of results into action. This project will build a co-created citizen science program coupled with a peer education model and an extensive communication of results to increase environmental STEM literacy. The project targets historically underrepresented populations that are likely to be disproportionately impacted by climate, water scarcity, and food security. Based upon past needs assessments in the targeted communities, gardens irrigated by harvested rainwater will become hubs for environmental STEM education and research. For this project, gardens irrigated by harvested rainwater will serve as hubs for environmental literacy education efforts. Researchers from the University of Arizona and Sonora Environmental Research Institute will work alongside community environmental health workers, who will then train families residing in environmentally compromised areas (urban and rural) on how to monitor their soil, plant, and harvested water quality. The project aims to: (1) co-produce environmental monitoring, exposure, and risk data in a form that will be directly relevant to the participants' lives, (2) increase the community's involvement in environmental decision-making, and (3) improve environmental STEM literacy and learning in underserved rural and urban communities. The project will investigate and gather extensive quantitative and quantitative data to understand how: (1) participation in a co-created citizen science project enhances a participant's overall environmental STEM literacy; (2) a peer-education model coupled with a co-created citizen science program affects participation of historically underrepresented groups in citizen science; and (3) the environmental monitoring approach influences the participant's environmental health learning outcomes and understanding of the scientific method. In parallel, this project will evaluate the role of local-based knowledge mediators and different mechanisms to communicate results. These findings will advance the fields of informal science education, environmental science, and risk communication. Concomitantly, the project will facilitate the co-generation of a robust dataset that will not only inform guidelines and recommendations for harvested rainwater use, it will build capacity in underserved communities and inform the safe and sustainable production of food sources. This research effort is especially critical for populations in arid and semiarid environments, which account for ~40% of the global land area and are inhabited by one-third of the world's population. This program will be available in English and Spanish and can truly democratize environmental STEM research and policy. This project is funded by the Advancing Informal STEM Learning program, which seeks to advance new approaches to, and evidence-based understandings of, the design and development of STEM learning in informal environments.
Chemistry is an important and widely relevant field of science. However, when compared with other STEM content areas, chemistry is under-represented in U.S. science museums and other informal educational environments. This project will build, and build knowledge about, innovative approaches to delivering informal science learning activities in chemistry. The project will not only increase public interest and understanding of chemistry but also increase public perception of chemistry's relevance and increase the public's self-efficacy with respect to chemistry. This project outcomes will include a guide for practitioners along with activity materials that will be packaged into a kit, distributed, and replicated for use by informal science educators, chemists, and chemistry students at 250 sites across the U.S. The project team will reach out to organizations that serve diverse audiences and diverse geographic locations, including organizations in rural and inner-city areas. The kits will provide guidance on engaging girls, people with various abilities, Spanish speakers, and other diverse audiences, and include materials in Spanish. Written guides, training videos, and training slides will be included to support training in science communication in general, as well as chemistry in particular. This project is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.
This project will take an innovative approach to develop informal educational activities and materials about chemistry. Rather than starting with content goals, the project will start with a theoretical framework drawn from research about affecting attitudes about science related to interest, relevance, and self-efficacy. A design-based research approach (DBR) will be used to apply that framework to the development of hands-on educational activities about chemistry, while also testing and modifying the framework itself. (DBR blends empirical educational research with the theory-driven design of learning environments.) Existing or new educational activities that appear to embody key characteristics defined in the framework will be tested with public audiences for their impact on visitors. Researchers and educators will determine how different characteristics of the educational activities defined in the framework affect the outcomes. The activities will be modified and tested iteratively until the investigators achieve close alignment between framework and impacts.. The project team will continue the design-based research approach both to examine groups of activities in which synergies can have impacts beyond single interactions as well as to examine varied ways of training facilitators who can also significantly affect outcomes. In this way, the project will generate knowledge about how kits of hands-on informal learning activities can stimulate attitudes of interest, relevance, and self-efficacy with respect to the neglected field of chemistry. The project teams will broadly disseminate project outcomes within the educational research, science and informal Science, Technology, Engineering and Mathematics (STEM) education communities. While this project will focus on chemistry, the strategies it will develop and test through a design-based research process will provide valuable insight into effective approaches for informal STEM education more broadly.
The rapid growth of the natural gas extraction industry in Pennsylvania and neighboring states has stirred concerned citizens to seek ways to collect data on water quality impacts from the extraction activities. As a response to requests from community members, the Alliance for Aquatic Resource Monitoring (ALLARM) developed a volunteer-friendly protocol in 2010 for early detection and reporting of surface water contamination by shale gas extraction activities in small streams. To date, ALLARM has trained more than 2,000 volunteers in Pennsylvania, New York, and West Virginia to monitor water
Recruiting more research scientists from rural Appalachia is essential for reducing the critical public health disparities found in this region. As a designated medically underserved area, the people of Appalachia endure limited access to healthcare and accompanying public health education, and exhibit higher disease incidences and shorter lifespans than the conventional U.S. population (Pollard & Jacobsen, 2013). These health concerns, coupled with the fact that rural Appalachian adults are less likely to trust people from outside their communities, highlights the need for rural Appalachian youth to enter the biomedical, behavioral, and clinical research workforce. However, doing so requires not only the specific desire to pursue a science, technology, engineering, math, or medical science (STEMM) related degree, it also requires the more general desire to pursue post-secondary education at all. This is clearly not occurring in Tennessee’s rural Appalachian regions where nearly 75% of adults realize educational achievements only up to the high school level. Although a great deal of research and intervention has been done to increase students’ interest in STEMM disciplines, very little research has considered the unique barriers to higher education experienced by rural Appalachian youth. A critical gap in past interventions research is the failure to address these key pieces of the puzzle: combatting real and perceived barriers to higher education and STEMM pursuits in order to increase self-efficacy for, belief in the value of, and interest in pursuing an undergraduate degree. Such barriers are especially salient for rural Appalachian youth.
Our long-range goal is to increase the diversity of biomedical, clinical and behavioral research scientists by developing interventions that both reduce barriers to higher education and increase interest in pipeline STEMM majors among rural Appalachian high school students. Our objective in this application is to determine the extent to which a multifaceted intervention strategy combining interventions to address the barriers to and supports for higher education with interventions to increase interest in STEMM fields leads to increased intentions to pursue an undergraduate STEMM degree. Our hypothesis is that students who experience such interventions will show increases in important intrapersonal social-cognitive factors and in their intentions to pursue a postsecondary degree than students not exposed to such interventions. Based on the low numbers of students from this region who pursue post-secondary education and the research demonstrating the unique barriers faced by this and similar populations (Gibbons & Borders, 2010), we believe it is necessary to reduce perceived barriers to college-going in addition to helping students explore STEMM career options. In other words, it is not enough to simply offer immersive and hands-on research and exploratory career experiences to rural Appalachian youth; they need targeted interventions to help them understand college life, navigate financial planning for college, strategize ways to succeed in college, and interact with college-educated role models. Only this combination of general college-going and specific STEMM-field information can overcome the barriers faced by this population. Therefore, our specific aims are:
Specific Aim 1: Understand the role of barriers to and support for higher education in Appalachian high school students’ interest in pursuing STEMM-related undergraduate degrees. We will compare outcomes for students who participate in our interventions, designed to proactively reduce general college-going barriers while increasing support systems, to outcomes for students from closely matched schools who do not participate in these interventions to determine the extent to which such low-cost interventions, which can reach large numbers of students, are effective in increasing rural Appalachian youth’s intent to pursue STEMM-related undergraduate degrees.
Specific Aim 2: Develop sustainable interventions that decrease barriers to and increase support for higher education and that increase STEMM-related self-efficacy and interest. Throughout our project, we will integrate training for teachers and school counselors, nurture lasting community partnerships, and develop a website with comprehensive training modules to allow the schools to continue implementing the major features of the interventions long after funding ends.
This research is innovative because it is among the first to recognize the unique needs of this region by directly addressing barriers to and supports for higher education and integrating such barriers-focused interventions with more typical STEMM-focused interventions. Our model provides opportunities to assess college-going and STEMM-specific self-efficacy, outcome expectations, and barriers/supports, giving us a true understanding of how to best serve this group. Ultimately, this project will allow future researchers to understand the complex balance of services needed to increase the number of rural Appalachians entering the biomedical, behavioral, and clinical research science workforce.
Citizen science refers to partnerships between volunteers and scientists that answer real world questions. The target audiences in this project are middle and high school teachers and their students in a broad range of settings: two urban districts, an inner-ring suburb, and three rural districts. The project utilizes existing citizen science programs as springboards for professional development for teachers during an intensive summer workshop. The project curriculum helps teachers use student participation in citizen science to engage them in the full complement of science practices; from asking questions, to conducting independent research, to sharing findings. Through district professional learning communities (PLCs), teachers work with district and project staff to support and demonstrate project implementation. As students and their teachers engage in project activities, the project team is addressing two key research questions: 1) What is the nature of instructional practices that promote student engagement in the process of science?, and 2) How does this engagement influence student learning, with special attention to the benefits of engaging in research presentations in public, high profile venues? Key contributions of the project are stronger connections between a) ecology-based citizen science programs, STEM curriculum, and students' lives and b) science learning and disciplinary literacy in reading, writing and math.
Research design and analysis are focused on understanding how professional development that involves citizen science and independent investigations influences teachers' classroom practices and student learning. The research utilizes existing instruments to investigate teachers' classroom practices, and student engagement and cognitive activity: the Collaboratives for Excellence in Teacher Preparation and Classroom Observation Protocol, and Inquiring into Science Instruction Observation Protocol. These instruments are used in classroom observations of a stratified sample of classes whose students represent the diversity of the participating districts. Curriculum resources for each citizen science topic, cross-referenced to disciplinary content and practices of the NGSS, include 1) a bibliography (books, web links, relevant research articles); 2) lesson plans and student science journals addressing relevant science content and background on the project; and 3) short videos that help teachers introduce the projects and anchor a digital library to facilitate dissemination. Impacts beyond both the timeframe of the project and the approximately 160 teachers who will participate are supported by curriculum units that address NGSS life science topics, and wide dissemination of these materials in a variety of venues. The evaluation focuses on outcomes of and satisfaction with the summer workshop, classroom incorporation, PLCs, and student learning. It provides formative and summative findings based on qualitative and quantitative instruments, which, like those used for the research, have well-documented reliability and validity. These include the Science Teaching Efficacy Belief Instrument to assess teacher beliefs; the Reformed Teaching Observation Protocol to assess teacher practices; the Standards Assessment Inventory to assess PLC quality; and the Scientific Attitude Inventory to assess student attitudes towards science. Project deliverables include 1) curriculum resources that will support engagement in five existing citizen science projects that incorporate standards-based science content; 2) venues for student research presentations that can be duplicated in other settings; and 3) a compilation of teacher-adapted primary scientific research articles that will provide a model for promoting disciplinary literacy. The project engages 40 teachers per year and their students.
DATE:
-
TEAM MEMBERS:
Karen OberhauserMichele KoomenGillian RoehrigRobert BlairAndrea Lorek Strauss