The San Diego Natural History Museum (theNAT) contracted RK&A to conduct a summative evaluation of the exhibition Extraordinary Ideas from Ordinary People: A History of Citizen Science and to explore how well the exhibition communicates an inclusive view of science. The goals for the evaluation were to explore visitors’ behaviors in the exhibition as well as understand what meanings visitors made from the exhibition, particularly with regard to how the exhibition’s messages about citizen science are resonating in the context of visitors’ science identity.
RK&A conducted timing and tracking
In an information free-for-all why should scientists bother to add their voice? In this commentary piece I argue there is an increasingly important role for scientists amongst the growing ranks of public intellectuals and the many who style themselves as such. First, we must become the sifters and sorters. We need to be willing to use our research and analytical skills to identify what is valuable amongst all the noise, and, if necessary, to volubly reject what is not. And, second, we need to create and defend the space everyone needs for deep thought and consideration. We need to influence
This paper provides an analysis of the implementation and the outcomes of Scienza Attiva, an Italian national project for secondary school students, that makes use of deliberative democracy tools to address socio-scientific issues of great impact. The analysis has required a mixed method including surveys of students' pre- and post-project opinions, focus groups and interviews with students and teachers. The results from this evaluation study provide evidence that the project improves students' understanding of socio-scientific issues, strengthens their awareness of the importance of
DATE:
TEAM MEMBERS:
Federica CornaliGianfranco PomattoSelena Agnella
resourceprojectProfessional Development, Conferences, and Networks
The scientific community has been under increasing pressure from policymakers and the public to explain how research contributes to the public good. The community has emphasized two distinct approaches to explaining its operations and value. The first is the use of narratives that can make the work of science more accessible and engaging to nonscientists. The other is the use of new data mining and analysis methods to document quantitatively the complex paths by which research progresses and eventually contributes to a variety of societal goals. While both of these approaches have proved useful, the goal of this workshop is to explore ways that they might be combined into a hybrid approach that will be even more effective.
This workshop will assemble experts in the narrative and data-driven science communication approaches with leading science researchers to discuss how these various perspectives can be merged to define a template for a type of communication that encompasses the appeal of narrative, the rigor of new analytic data, and the understanding of how science works in practice.
DATE:
-
TEAM MEMBERS:
Kevin Finneran
resourceresearchProfessional Development, Conferences, and Networks
How should we convey science—both its findings and its value to society—to the many members of the public who lack either scientific training or intense interest in scientific progress? In October 2016 the National Academies of Sciences, Engineering, and Medicine convened a workshop to explore ways of better presenting science—both specific findings and the processes of discovering and confirming—to the public. Participants discussed ways to develop data-enriched narratives that communicate to the public and policy makers in an engaging and rigorous way the work of basic research. They also
DATE:
TEAM MEMBERS:
National Academies of Sciences, Engineering, and Medicine
The Discovery Research K-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.
STEM Practice-rich Investigations for NGSS Teaching (SPRINT) is an exploratory project that will research and develop resources and a model for professional learning needed to meet the demand of implementing the Next Generation Science Standards (NGSS). The Exploratorium Teacher Institute will engage middle school science teachers in a one-year professional learning program to study how familiar routines and classroom tools, specifically hands-on science activities, can serve as starting points for teacher learning. The Teacher Institute will use existing hands-on activities as the basis for developing "practice-rich investigations" that provide teachers and students with opportunities for deep engagement with science and engineering practices. The results of this project will include: (1) empirical evidence from professional learning experiences that support teacher uptake of practice-rich investigations in workshops and their classrooms; (2) a portfolio of STEM practice-rich investigations developed from existing hands-on activities that are shown to enhance teacher understanding of NGSS; and (3) a design tool that supports teachers in modifying existing activities to align with NGSS.
SPRINT conjectures that to address the immediate challenge of supporting teachers to implement NGSS, professional learning models should engage teachers in the same active learning experiences they are expected to provide for their students and that building on teachers' existing strengths and understanding through an asset-based approach could lead to a more sustainable implementation. SPRINT will use design-based research methods to study (a) how creating NGSS-aligned, practice-rich investigations from teachers' existing resources provides them with experiences for three-dimensional science learning and (b) how engaging in these investigations and reflecting on classroom practice can support teachers in understanding and implementing NGSS learning experiences.
One common barrier to STEM engagement by underserved and underrepresented communities is a feeling of disconnection from mainstream science. This project will involve citizen scientists in the collection, mapping, and interpretation of data from their local area with an eye to increasing STEM engagement in underrepresented communities. The idea behind this is that science needs to start at home, and be both accessible and inclusive. To facilitate this increased participation, the project will develop a network of stakeholders with interests in the science of coastal environments. Stakeholders will include members of coastal communities, academic and agency scientists, and citizen science groups, who will collectively and collaboratively create a web-based system to collect and view the collected and analyzed environmental information. Broader impacts include addressing the STEM barriers to those who reside in the coastal environment but who are underrepresented in STEM education, vocations and policy-making. These include tribal communities (racial and ethnic inclusion), fishery communities (inclusion of communities of practice), and rural communities without direct access to colleges or universities. This project will create a physical, a social, and a virtual, environment where all participants have an equal footing in the processes of "doing science" - the Coastal Almanac. The Almanac is simultaneously a network of individuals and organizations, and a web-based repository of coastal data collected through the auspices of the network. During the testing phase, the researchers will implement the "rules of engagement" through multiple interaction pathways in the growing Coastal Almanac network: increases in rigorous citizen science, development of specific community-scientist partnerships to collect and/or use Almanac data, development of K-12 programs to collect and/or use Almanac data. The proposed work will significantly scale up citizen science and community-based science programs on the West Coast, broadening participation by targeting members of coastal communities with limited access to mainstream science, including participants from non-STEM vocations, and Native Americans. The innovation of the Coastal Almanac is in allowing the process of deepening involvement in science, and through that process increasing agency of community members to be bona fide members of the science team, to evolve organically, in the manner dictated by community members and the situation, rather than a priori by the project team and mainstream science. The project has the potential in the long-term to increase participation in marine science education, workforce, and policy-making by underrepresented groups resident in the coastal environment. Contributions by project citizen scientists will also provide valuable data to mainstream science and to resource management efforts.
DATE:
-
TEAM MEMBERS:
Julia ParrishMarco HatchSelina Heppell
The Yellowstone Altai-Sayan Project (YASP) brings together student and professional researchers with Indigenous communities in domestic (intermountain western U.S.) and international (northwest Mongolian) settings. Supported by a National Science Foundation grant, MSU and tribal college student participants performed research projects in their home communities (including Crow, Northern Cheyenne, Fort Peck Assiniboine & Sioux, and Fort Berthold Mandan, Hidatsa and Sahnish) during spring semester 2016. In the spirit of reciprocity, these projects were then offered in comparative research contexts during summer 2016, working with Indigenous researchers and herder (semi-nomadic) communities in the Darhad Valley of northwestern Mongolia, where our partner organization, BioRegions International, has worked since 1998. In both places, Indigenous Research Methodologies and a complementary approach called Holistic Management guided how and what research was performed, and were in turn enriched by Mongolian research methodologies. Ongoing conversations with community members inspire the research questions, methods of data collection, as well as how and what is disseminated, and to whom. The Project represents an ongoing relationship with and between Indigenous communities in two comparable bioregions*: the Big Sky of the Greater Yellowstone Ecosystem, and the Eternal Blue Sky of Northern Mongolia.
*A ‘bioregion’ encompasses landscapes, natural processes and human elements as equal parts of the whole (see http://bioregions.org/).
DATE:
-
TEAM MEMBERS:
Kristin RuppelClifford MontagneLisa Lone Fight
This is a two-year "Inclusion across the Nation of Communities of Learners of Underrepresented Discoverers in Engineering and Science" (INCLUDES) Design and Development Launch Pilot targeting high school students in the Hudson Valley, including the New York Metropolitan Area. It will support a network of institutional partners that are committed to providing internship and mentoring opportunities to youths interested in authentic research projects. The proposed work will build on a current research immersion program--the Secondary School Field Research Program (SSFRP) at Columbia University's Lamont-Doherty Earth Observatory. SSFRP serves high school students, mainly from underrepresented and underserved communities, who work with college students, science teachers, and researchers around a specific science problem. Over the past decade, the program has had demonstrable impact, including attendance to college, and students' selection of STEM majors. Tracking data indicates that retention rates of its alumni in four-year colleges are well above the norm, and a significant fraction of early participants are now in graduate programs in science or engineering. The program has surpassed all expectations in its effectiveness at engaging underserved populations in science and promoting entry into college, recruitment into STEM majors, and retention through undergraduate and into graduate studies. Hence, the project's overall goal will be to extend and adapt the research-immersive summer internship model through an alliance with peer research institutions, school districts and networks, public land and resource management agencies, private funding agencies, informal educational institutions, and experts in pedagogical modeling, metrics, and evaluation. Focused on earth and environmental sciences, the summer and year-round mentoring model will allow high school students to work in research teams led by college students and teachers under the direction of research scientists. The mentoring model will be multilayered, with peer, near-peer, and researcher-student relationships interweaving throughout the learning process.
The project has formulated a set of testable explanatory hypotheses: (1) Beyond specific subject knowledge, success rests on increased student engagement in a community of practice, with near-peer mentors, teachers, and scientists in the context of scientific research; (2) The intensity of engagement also shifts the students' vision of their future to include higher education, and specifically to imagine and move toward a STEM career; and (3) Early engagement, before students attend college, is critical because high school is where students form patterns of engagement and capacities related to science learning. Thus, the immediate goal of the two-year plan will be to create approximately 11 research internship programs focused on earth and environmental sciences, and to build the networks for growth through engagement with a wider community of educational partners. The main focus of this approach will be removing barriers between high school students and STEM organizations, and adapting the current mentoring model at Columbia University to the specific cultures of other research groups and internship programs throughout the lower Hudson Valley. The team has already assembled a diverse set of partners committed to broadening participation in STEM using a collective impact approach to early engagement in project-based learning. Research partners will provide the mentors, research projects, and laboratory facilities. The educational network partners will provide access for students, particularly those from under-resourced communities to participate, as well as participation opportunities for interested teachers. Informal learning organizations will provide access to field and research sites, along with research dissemination opportunities. In Year 1, the project will conduct a series of development workshops for partners already in place and foster the formation of new partnership clusters according to shared interest, complementary resources and geographic proximity. The workshops will provide a forum for partners to learn about each other's visions, values, challenges, and existing structures, while working through theoretical and practical issues related to STEM engagement for young investigators. In Year 2, the project will target the implementation of the internship programs at various sites according to the agreed-upon goals, program model, research projects, recruitment and retention strategy, staff training, data collection, and evaluation plans. An external evaluator will address both the formative and summative evaluation of the effort directed toward examining the three project's hypotheses concerning the educational impacts of scientific research on student engagement, extent of the immersion, and overall effectiveness of the programs.
DATE:
-
TEAM MEMBERS:
Robert NewtonLuo Cassie XuMargie TurrinEinat LevMatthew Palmer
Through the NSF Innovation Corps for Learning Program, (I-Corps L), this project will develop ways to enable the SciStarter program to extend the promise of citizen science by connecting millions of citizen scientists with scientists in need of their help through formal and informal research projects. Citizen science is a fast growing field that engages the public in scientific inquiry through data collection projects and environmental monitoring using sensors, mini spectrometers, water testing kits and other tools. A challenge for the citizen science community has been access to the tools required to collect the types of data needed in citizen science projects. SciStarter facilitates broader participation in citizen science by reducing the barrier for volunteers to identify, acquire, and use the right scientific tools and instruments for each project. This I-Corps for Learning project will develop approaches to enable SciStarter to provide a larger number of citizen scientists with easier access to required and recommended instruments needed for meaningful participation in citizen science projects.
SciStarter aims to provide a holistic solution to the needs of citizen scientists that includes projects, support, and products such as training materials and consulting. SciStarter can be a catalyst in citizen science by connecting people to opportunities to engage and in lowering barriers to public participation in scientific research while creating a hybrid academic-consumer sustainability model. A central focus of this current effort will be establishing a sustainable and scalable means of enabling citizen scientists to obtain equipment and instruments in an efficient and cost-effective manner. The project will make use of elements already in place to expand the engagement of citizen scientists in new or multiple projects, to empower citizens in the process of citizen science, and to provide a useful, scalable and sustainable solution for scientists leading citizen science research projects. The extension of SciStarter will set the stage for greater inclusion of previously marginalized groups in citizen science activities and will extend to all forms of public engagement in science.
Informal learning, and by extension, museums, are inherently emotional experiences, evoking feelings of awe, excitement, and curiosity. Oftentimes, museum professionals have prioritized traditionally positive emotions such as excitement and interest as being the most desirable and useful in supporting museum learning. However, prior research into naturally occurring emotions at museums found that some visitors who experienced negative emotions, such as confusion or frustration, at exhibits also reported deeper engagement and overall feelings of satisfaction (Rappolt-Schlichtmann et al., 2017). Based on these findings and similar results from formal education (D’Mello et al., 2014), this project team has worked to develop and refine a framework of strategies for creating exhibits that invoke and support visitors through the complex emotional state called productive struggle (PS) which is defined as a three-part emotional arc characterized by: 1) disequilibrium (experienced emotionally as emotions like confusion, frustration, surprise, or unease) that arises from encountering a challenging task, phenomenon, or idea, 2) persistence through the task which is supported by exhibit design scaffolds, and 3) an emotionally productive resolution tied to the source of disequilibrium or an overall sense of effortful achievement. In deliberately attending to and supporting a range of negative and positive emotions in museums, visitors can gain access to a wider variety of complex emotional experiences, including those critical to STEM learning, and have potential to broaden participation in STEM by supporting learners' diverse emotional needs and preferences.
This multidisciplinary project team consisting of researchers and exhibit professionals utilized a design-based research (DBR) process to develop, test, and refine a definition of museum-based productive struggle, and create a framework of design strategies that support PS. Three physical exhibits and a virtual exhibit were created during this multi-year project. Additionally, a summative research study was conducted with 105 youth ages 10-17 to explore: 1) whether visitors experienced the expected emotional arc of PS; 2) how exhibit design strategies supported PS; and 3) the extent of visitors’ learning and engagement at these PS exhibits.
The Northwest Passage Project (NPP) is a collaborative effort between the University of Rhode Island (URI), Inner Space Center (ISC), Graduate School of Oceanography (GSO), the film company David Clark Inc., and several other partners, including six Minority Serving Institutions (MSIs) and three informal science education institutions. The project centers on a research expedition into the Arctic's Northwest Passage, which will engage intergenerational cohorts of high school, undergraduate, and graduate students in hands-on research aboard the U.S. tall ship SSV Oliver Hazard Perry (OHP). During the expedition, a professional film crew will produce a two-hour documentary focused on the NPP's innovative model of interdisciplinary informal STEM (science, technology, engineering, and mathematics) learning and highlight the expedition's research, participants, and the sociological issues related to the changing Arctic environment. Because the Canadian Arctic is remote and costly to access, the project will maximize NSF's investment by giving broad audiences access to the science and excitement of the expedition through the documentary. In addition, this informal science learning opportunity will not only engage students with scientists in authentic research, but also train the students to deliver daily live broadcasts from sea to three well-established U.S. informal science education institutions: the Smithsonian National Museum of Natural History (NMNH), the Exploratorium, and the Alaska Sea Life Center (ASLC). The daily broadcasts will also reach the public in real time via the project's interactive website, providing the opportunity for people to post questions to the scientists and students onboard the ship. The NPP has great potential to benefit society by enhancing awareness of the changing Arctic's ecosystems and increasing science literacy. The hands-on research experiences will enhance the college readiness of the participating high school students and encourage the undergraduate students from the six partner MSIs to consider a graduate course of study and/or pursue STEM careers. The graduate students will also be more career-ready, as they gain public communication and leadership skills necessary for 21st century scientists. The Northwest Passage Project is designed to advance knowledge and understanding within the practice of informal science education, as well as in the field of Arctic science. The project goals include: increasing public awareness and understanding of the changing Arctic ecosystem; increase public understanding about Arctic research and the scientific process; increase the Informal Science Education (ISE) field's understanding of the public's learning process when engaged in live interactions with scientists and student 'science communicators'; increase the ISE field's understanding of the value of immersive science experiences and impact on students from underserved and underrepresented populations; and to build or extend the capacity of ISE institutions to make connections between polar scientists, students, journalists and the public. The NPP is creative in that it combines the engagement of students in field-based scientific research, live broadcasts from sea to ISE institutions, and the production of a full-scale documentary for public audiences. A potentially transformative component to the ISE activities involves six Minority Serving Institution partners--Florida International University; University of Illinois, Chicago; California State University, Channel Islands; Texas State University; Virginia Commonwealth University and City College of New York--whose students will have the opportunity for a life-changing experience that may tip the scale toward their interest in STEM careers. Each of these students will develop news stories, host screenings of the film at their respective campuses, and share their experiences with peers, providing visual role models for other underrepresented students, who may never have thought themselves capable of becoming a scientist or science communicator. An additional project goal is to enhance the capacity and infrastructure of the three ISE partner institutions so that they may receive live broadcasts from the Inner Space Center in the future, beyond the funding period of the project. People, Places & Design Research will conduct the project's front-end and formative evaluation; MEM & Associates will conduct the summative evaluation. Some of the key evaluation questions will be: * Have ISE and MSI institution public visitors, who view either the live broadcasts or the documentary film (or both), become more aware of the changing Arctic ecosystem and the importance of scientific research in the Arctic? * What is the relative impact of the live broadcasts compared to the finished documentary, and the strengths and weakness of the respective media in translating the on-board experience? * Does a real environmental and social context for scientific evidence stimulate audiences to become more interested in the role of science/STEM? * Have students gained leadership skills and the ability to communicate science to their peers? * Have students increased their motivation and interest in pursuing STEM careers? This project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants.
DATE:
-
TEAM MEMBERS:
Gail ScowcroftDavid ClarkBrice LooseDwight Coleman