Citizen science is a form of Public Participation in Scientific Research (PPSR) in which the participants are engaged in the scientific process to support research that results in scientifically valid data. Opportunities for participation in real and authentic scientific research have never been larger or broader than they are today. The growing popularity and refinement of PPSR efforts (such as birding and species counting studies orchestrated by the Cornell Lab of Ornithology) have created both an opportunity for science engagement and a need for more research to better implement such projects in order to maximize both benefits to and contributions from the public.
Towards this end, Shirk et al. have posted a design framework for PPSR projects that delineates distinct levels of citizen scientist participation; from the least to the highest level of participation, these categories are contract, contribute, collaborate, co-create, and colleagues. The distinctions among these levels are important to practitioners seeking to design effective citizen science programs as each increase in citizen science participation in the scientific process is hypothesized to have both benefits and obstacles. The literature on citizen science models of PPSR calls for more research on the role that this degree of participation plays in the quality of that participation and related learning outcomes (e.g., Shirk et al., 2012; Bonney et al., 2009). With an unprecedented interest in thoughtfully incorporating citizen science into health-based studies, citizen science practitioners and health researchers first need a better understanding of the role of culture in how different communities approach and perceive participation in health-related studies, the true impact of intended educational efforts from participation, and the role participation in general has on the scientific process and the science outcome.
Project goal to address critical barrier in the field: Establish best practices for use of citizen science in the content area of human health-based research, and better inform the design of future projects in PPSR, both in the Denver Museum of Nature & Science’s Genetics of Taste Lab (Lab), and importantly, in various research and educational settings across the field.
Aims
Understand who currently engages in citizen science projects in order to design strategies to overcome the barriers to participation that occur at each level of the PPSR framework, particularly among audiences underrepresented in STEM.
Significantly advance the current knowledge regarding how citizen scientists engage in, and learn from, and participate in the different levels of the PPSR framework.
Determine the impact that each stage of citizen science participation has on the scientific process.
The National Building Museum contracted RK&A to conduct an evaluation Investigating Where We Live (IWWL), a long-running program that has brought together creative youth in the Washington, D.C. area every summer since 1996 to explore, document, and interpret the local built environment. The study goal was to examine program strengths and challenges to help NBM strategically plan for the program’s future.
How did we approach this study?
To hear a variety of perspectives on the program, RK&A conducted in-depth telephone interviews with a number of stakeholders with different
American Indian and Alaska Native communities continue to disproportionately face significant environmental challenges and concerns as a predominately place-based people whose health, culture, community, and livelihood are often directly linked to the state of their local environment. With increasing threats to Native lands and traditions, there is an urgent need to promote ecological sustainability awareness and opportunities among all stakeholders within and beyond the impacted areas. This is especially true among the dozens of tribes and over 50,000 members of the Coast Salish Nations in the Pacific Northwest United States. The youth within these communities are particularly vulnerable. This Innovations in Development project endeavors to address this serious concern by implementing a multidimensional, multigenerational model aimed at intersecting traditional ecological knowledge with contemporary knowledge to promote: (a) environmental sustainability awareness, (b) increased STEM knowledge and skills across various scientific domains, and (c) STEM fields and workforce opportunities within Coast Salish communities. Building on results from a prior pilot study, the project will be grounded on eight guiding principles. These principles will be reflected in all aspects of the project including an innovative, culturally responsive toolkit, curriculum, museum exhibit and programming, workshops, and a newly established community of practice. If successful, this project could provide new insights on effective mechanisms for not only promoting STEM knowledge and skills within informal contexts among Coast Salish communities but also awareness and social change around issues of environmental sustainability in the Pacific Northwest.
Over a five-year period, the project will build upon an extant curriculum and findings codified in a pilot study. Each aspect of the pilot work will be refined to ensure that the model established in this Innovations and Development project is coherent, comprehensive, and replicable. Workshops and internships will prepare up to 200 Coast Salish Nation informal community educators to implement the model within their communities. Over 2,500 Coast Salish Nation and Swinomish youth, adults, educators, and elders are expected to be directly impacted by the workshops, internships, curriculum and online toolkit. Another 300 learners of diverse ages are expected to benefit from portable teaching collections developed by the project. Through a partnership with the Washington State Burke Natural History Museum, an exhibit and museum programming based on the model will be developed and accessible in the Museum, potentially reaching another 35,000 people each year. The project evaluation will assess the extent to which the following expected outcomes are achieved: (a) increased awareness and understanding of Indigenous environmental sustainability challenges; (b) increased skills in developing and implementing education programs through an Indigenous lens; (c) increased interest in and awareness of the environmental sciences and other STEM disciplines and fields; and (d) sustainable relationships among the Coast Salish Nations. A process evaluation will be conducted to formatively monitor and assess the work. A cross cultural team, including a recognized Coast Salish Indigenous evaluator, will lead the summative evaluation. The project team is experienced and led by representatives from the Swinomish Indian Tribal Community, Oregon State University, Garden Raised Bounty, the Center for Lifelong STEM Learning, the Urban Indian Research Institute, Feed Seven Generations, and the Burke Museum of Natural History and Culture.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
Museums in the US receive approximately 55 million visits each year from students in school groups. Field trip visits to an art museum have been found to positively impact critical thinking skills, empathy and tolerance - an increase that can be even more significant for youth from rural or high-poverty regions. While field trips are popular, especially at science museums, there have been no experimental studies about their impact on STEM career choices and interests, much less any which used a culturally sensitive and responsive approach. Given the resources put into field trips, this study investigates if causal links can be drawn between museum experiences and impact on youth. The Museum of Science & Industry uses a Learning Labs approach for engaging its visitors. These "Learning Labs" are facilitated experiences that run roughly an hour. Currently there are 12 lab topics. This study focuses on MedLab--one of the learning labs--as the setting for the research. MedLab is designed for on-site and online experience using ultra-sophisticated and highly versatile technology in challenges taken from research on the top healthcare issues that face adolescents in their communities.
This study is informed by research and theory on Social Cognitive Career Theory (SCCT) and Racial and Ethnic Identity. The former describes a process many follow when thinking about career options, broadly. The latter describes how people see themselves in the world through their membership with a racial and/or ethnic group. Both processes can collectively influence STEM career choices. This study follows an embedded mixed-method design. The quantitative portion includes an experimental, pre/post/delayed post-test design of both educators and their students using multiple measures taken mostly from previously published instruments. The qualitative portion includes observation rubrics of MedLab sessions along with interviews and focus groups with staff, educators, students and families that take place both within and outside of the museum. This is an experimental study of moderate size of both heterogeneous teacher and student populations in real world settings. It involves comparing youth and educators that participate in MedLab with those who do not. By conducting research that looks at each community through the lens of their unique experiences, the research will measure their impact more sensitively and authentically, addressing a gap in current literature on informal science, technology, engineering, or mathematics (STEM) career education with diverse students.
This study is funded by the Advancing Informal STEM Learning (AISL) program and the Innovative Technology Experiences for Students and Teachers (ITEST) program.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This Research in Service to Practice project will bring together representatives from six long-standing youth programs, experts in the field of out-of-school-time youth programming, and education researchers to collaboratively explore the long-term (15-25 years) impact of STEM-focused, intensive (100+ hours/year), multi-year programming. The six partnering programs have maintained records with a combined total of over 3000 alums who participated between 1995 and 2005. This four-year research project uses an explanatory, sequential, mixed-method design to carry out four steps: (1) identify and describe the impact on the lives of program alums who are now ages 30 to 45; (2) identify causal pathways from program strategies to long-term outcomes; (3) develop an understanding of these pathways from the perspective of the people who experienced them; and (4) disseminate this knowledge broadly to those associated with STEM-focused programming. Research questions include: How did these programs affect youth's lives as they progressed toward and into adulthood? What program strategies and what participant attributes contributed most to the staying power of these effects? What life events and social structures supported and inhibited participant outcomes? This project describes the effects, identifies the causal pathways, and produces materials that programs can use for both strategic planning and generating support resources. Additionally, this project provides research methodology for organizations that want to conduct their own retrospective research and lays a foundation for a more comprehensive study that includes programs without historical documentation. The project aligns with NSF's Big Idea "NSF INCLUDES: Transforming education and career pathways to help broaden participation in science and engineering" by providing essential information about the long-term effect of interventions on educational and career pathways in STEM.
The project's approach involves three phases: (1) research preparation, (2) causal structural modeling of survey data from approximately 2,000 respondents, and (3) rich qualitative follow-up. Human ecological and self-determination theories inform data collection and analyses at every project phase. In the preparation phase, program staff complete program profiles from an historic perspective by identifying program strategies that may have included, for example, scientific research, robotics development, teaching science in informal settings, and working in scientific research labs. In the quantitative phase, the project will recruit alums who attended one of the 6 youth programs between 1995 and 2005 to submit a current resume and complete an online questionnaire, based on the following scaled variables: retrospective recall of basic psychological need satisfaction and frustration in relation to perceived program strategies; STEM identity (at three time periods: pre-program; post-program; and current); current well-being; career influences; and career barriers. The questionnaire also includes open-ended questions about life events related to the following categories: family and friends, school and work, and living conditions. Analysis of the questionnaire will lead to development of a causal structural model. In the qualitative phase, data will be collected from a purposefully selected sample of 30 alums based on findings from the quantitative phase. Methods include interviews, photo journals, and STEM pathways maps. Analysis of interviews, resumes, and photo journals take place within the structure of basic psychological need satisfaction and motivational quality across ecological systems over time. Qualitative analysis uses the constant comparative method, and findings are used to update and refine the final causal structural model and inform overall findings, conclusions, and recommendations of the project.
Since the 1990s, out-of-school time programs have engaged youth from underserved communities in STEM learning and in building interest in STEM careers, yet these programs often based on untested assumptions that participation has lasting effects on education, career, and life choices related to STEM. This Research in Service to Practice project has the potential to 1) guide practitioners in program improvement and improved program outcomes; 2) provide insight into achieving program goals, such as equity, increased well-being of participants, an informed citizenry, and a diversified STEM workforce; and 3) inform multi-stakeholder decision-making with respect to this type of programming. This research also builds a foundation of research data collection and analysis methods to guide and support future research on long term-impacts and youth STEM programming. Dissemination strategies include a website, webinars, video, infographics, conference presentations, and written reports to reach stakeholders including practitioners, researchers, administrators, and funders.
This project is funded by the National Science Foundation's (NSF's) Advancing Informal STEM Learning (AISL) program, which supports innovative research, approaches, and resources for use in a variety of learning settings.
This report details the results of a five-year longitudinal study on the Explainer program at the Exploratorium. Explainers from the summer 1999, fall 1999 and spring 2000 cohorts were interviewed before and after their first semester of work as an Explainer, then followed up with additional interviews three more times at intervals of from one to three years. Additional supplemental data were gathered from a larger set of Explainers via surveys that were administered to these same cohorts before and after their first semester of work, and to a set of Explainer alumni who had been out of the
The PEAR Institute: Partnerships in Education and Resilience at McLean Hospital and Harvard Medical School conducted a year-long study of the Tulsa Regional STEM Alliance (TRSA). Funded by the Overdeck Family Foundation, STEM Next Opportunity Fund, and the Charles and Lynn Schusterman Family Foundation, this study is the first of its kind among 68 national and international STEM Ecosystems.
DATE:
TEAM MEMBERS:
Kristin Lewis-WarnerPatricia AllenGil Noam
An in-depth case study of one of America’s first STEM Learning Ecosystems in Tulsa, Oklahoma, conducted by researchers at The PEAR Institute: Partnerships in Education and Resilience, finds that strong leadership, deep partnerships, and data-informed methods have led to the creation of diverse, high-quality, STEM-rich learning opportunities for Tulsa’s youth. Additionally, these efforts improved the capacity of STEM educators through high-quality professional development and supported youth pathways to STEM careers by increasing mentoring opportunities for STEM professionals.
These findings
DATE:
TEAM MEMBERS:
Kristin Lewis-WarnerPatricia AllenGil Noam
This annual report presents an overview of Saint Louis Science Center audience data gathered through a variety of evaluation studies conducted during 2015. This report includes information on the Science Center's general public audience demographics and visitation patterns, gives an overview of visitors' comments about their Science Center experience, summarizes major trends observed in the Science Center's tool for tracking educational programs, and presents highlights from a Membership study, a formative evaluation of a new Makerspace exhibition, and program evaluation of a workshop for the
In April 2018, FHI 360, under the leadership of Maryann Stimmer and Merle Froschl, convened a meeting of thought leaders in Washington, D.C. to capture a “snapshot” of STEM education. They subsequently conducted additional interviews with more than 50 local and national policy leaders; public and private funders; researchers; PreK-12 and post-secondary educators; parents, and leaders of afterschool programs, science centers and youth-serving organizations. The purpose of this summary report is to identify current trends and gaps to inform research, policy, and practice in order to reinforce
This Conference Paper was presented at the International Soceity for the Learning Sciences Confernece in June 2018. We summarize interviews with youth ages 9-15 about their failure mindsets, and if those midsets cross boundaries between learning environments.
Previous research on youth’s perceptions and reactions to failure established a view of failure as a negative, debilitating experience for youth, yet STEM and in particular making programs increasingly promote a pedagogy of failures as productive learning experiences. Looking to unpack perceptions of failure across contexts and
With funding from a Smithsonian Institution Youth Access Grant the National Museum of Natural History offered a program pipeline that would engage underserved Washington D.C. students in programming designed to encourage academic and career STEM interest. Beginning with collaboration with community educators, the pipeline funneled students into a Teen Night Out Science Night to interest them in science workshop series offered after school and on weekend and ultimately into volunteer and internship opportunities. This report provides detailed view of methods, analyses, results, and conclusions