This document is the final evaluation report for the project, which focuses both on formative evaluation of the collaborative+interdisciplinary presentation creation process and summative evaluation of audience learning outcomes.
Meaningful science engagement beyond one-way outreach is needed to encourage science-based decision making. This pilot study aimed to instigate dialogue and deliberation concerning climate change and public health. Feedback from science café participants was used to design a panel-based museum exhibit that asked visitors to make action plans concerning such issues. Using intercept interviews and visitor comment card data, we found that visitors developed general or highly individualistic action plans to address these issues. Results suggest that employing participatory design methods when
The Year in ISE is a slidedoc designed to track and characterize field growth, change and impact, important publications, and current topics in ISE in 2018. Use it to inform new strategies, find potential collaborators for your projects, and support proposal development. Scope This slidedoc highlights a selection of developments and resources in 2018 that were notable and potentially useful for the informal STEM education field. It is not intended to be comprehensive or exhaustive, nor to provide endorsement. To manage the scope and length, we have focused on meta analyses, consensus reports
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This includes providing multiple pathways for broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. This Innovations in Development project will develop a collaborative program to connect and prepare researchers from divergent disciplines to communicate science to publics of all ages in three distinct informal environments: pop-ups at community events, experiential learning with problem solving events for youth, and presentations at a science museum. It will study the effects of this program on the identity and motivations of STEM researchers and evaluate the short and medium-term outcomes for public audiences. Project partners include, The STEAM Factory, OHI/O Informal Learning in Tech Program, and the Center of Science and Industry (COSI) all located in Columbus, Ohio.
The primary goals of this project are as follows. 1) Develop a collaborative program that connects and prepares researchers from divergent disciplines to creatively and effectively communicate science to people of all ages. 2) Evaluate the short and medium-term learning outcomes across different informal learning settings. 3) Study the effect of this collaborative program on the motivations and identify of the researchers. The specific research question is: In what ways do researchers motivations and identities further develop because of these collaborative experiences with divergent perspectives? A mixed method approach will be used. Data will be collected and analyzed from 3 cohorts of researchers who implement programs in different informal learning settings. A series of pre- and post interviews with scientists will be designed to answer the research question above. Interviews will be grounded in self-determination theory. Later reflective surveys will serve as triangulation for the data.
This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
DATE:
-
TEAM MEMBERS:
Sathya GopalakrishnanJustin MeyerRachel KajfezArnab Nandi
Many scientists want to connect with the public, but their efforts to do so are not always easy or effective. Visionary programs and institutions are leading the way identifying the support needed to enable scientists’ connections with the public. However, the current appetite by -- and demand for -- scientists to do this exceeds the capacity of those who facilitate quality communication and engagement efforts. More can be done to ensure that those who support scientists are networked, sharing best practices, and supported by a reliable infrastructure.
This workshop series, convened by the Kavli, Rita Allen, Packard and Moore Foundations, was intended to view the entire system of people who support scientists’ engagement and communication efforts in order to explore how this system can be most effective and sustainable. The discussions examined where this system is thriving, the limits people within the system face and what can be done to ensure their efforts are commensurate with the demand for quality communication and engagement support.
Conducted over four closely scheduled workshops in late 2017 and early 2018, the convenings brought together leaders in different parts of the field who bridge scientists and the public and led to the emergence of a number of key priority areas. While the initial intention was to also hold a plenary event to provide a more holistic view of scientists’ support system in order to collectively discern directions to advance the field, we feel a more efficient way forward right now is to focus our efforts and resources on building community and advancing these priority areas.
Our invitation-only workshops brought together scientists, academic leaders, engagement professionals, researchers, communication trainers, and foundation leaders. For each workshop, we also commissioned a “landscape overview”, to better understand the high-level state of each community. Workshops included:
Workshop I: Communication and engagement training programs - Dec. 4-5, 2017 at SUNY Global Center/Alan Alda Center for Communicating Science in New York
Workshop II: Associations, societies and other professional organizations - Feb. 28 - March 1, 2018 at the Howard Hughes Medical Institute in Chevy Chase, MD
Workshop III: Academic institutions - March 27-28, 2018 at UC San Diego
Workshop IV: Science engagement facilitators (museums, science festivals, connectors) - May 2-3, 2018 at Monterey Bay Aquarium
TBD - Workshop V: Plenary event
The goal of the workshops was to explore how to ensure scientists’ communication and engagement support is effective and sustained. In doing so, we hoped to 1) deepen our understanding of how scientists are currently supported in these areas, 2) map the broader support system to expose the opportunities and obstacles that play a role in achieving this goal, and 3) identify strategic and practical next steps that move us closer to this goal. This initiative also aimed to forge and strengthen networks across communities and institutions – and in so doing, take a view of the entire system to explore how everyone can better ensure their efforts are impactful, mutually supportive, and connected to a greater whole.
Included in the links below are summaries from each workshop.
This CAISE report is designed to track and characterize sector growth, change and impact, important publications, hot topics/trends, new players, funding, and other related areas in Informal STEM Education (ISE) in 2017. The goal is to provide information and links for use by ISE professionals, science communicators, and interested stakeholders who want to discover new strategies and potential collaborators for project and proposal development. Designed as a slide presentation and divided into sectors, it can be used modularly or as a complete report. Each sector reports on research, events
An evaluation toolkit developed as part of the EU-funded PLACES project was applied in 26 case studies across Europe. Results show, among other things, the contribution of science communication initiatives to public curiosity, professional networking and perception of cities where these initiatives are stronger.
This is an efficacy study through which the Denver Museum of Nature and Science, the Denver Zoo, the Denver Botanic Gardens, and three of Denver's urban school districts join efforts to determine if partnerships among formal and informal organizations demonstrate an appropriate infrastructure for improving science literacy among urban middle school science students. The Metropolitan Denver Urban Advantage (UA Denver) program is used for this purpose. This program consists of three design elements: (a) student-driven investigations, (b) STEM-related content, and (c) alignment of schools and informal science education institutions; and six major components: (a) professional development for teachers, (b) classroom materials and resources, (c) access to science-rich organizations, (d) outreach to families, (e) capacity building and sustainability, and (e) program assessment and student learning. Three research questions guide the study: (1) How does the participation in the program affect students' science knowledge, skills, and attitudes toward science relative to comparison groups of students? (2) How does the participation in the program affect teachers' science knowledge, skills, and abilities relative to comparison groups of teachers? and (3) How do families' participation in the program affect their engagement in and support for their children's science learning and aspirations relative to comparison families?
The study's guiding hypothesis is that the UA Denver program should improve science literacy in urban middle school students measured by (a) students' increased understanding of science, as reflected in their science investigations or "exit projects"; (b) teachers' increased understanding of science and their ability to support students in their exit projects, as documented by classroom observations, observations of professional development activities, and surveys; and (c) school groups' and families' increased visits to participating science-based institutions, through surveys. The study employs an experimental research design. Schools are randomly assigned to either intervention or comparison groups and classrooms will be the units of analysis. Power analysis recommended a sample of 18 intervention and 18 comparison middle schools, with approximately 72 seventh grade science teachers, over 5,000 students, and 12,000 individual parents in order to detect differences among intervention and comparison groups. To answer the three research questions, data gathering strategies include: (a) students' standardized test scores from the Colorado Student Assessment Program, (b) students' pre-post science learning assessment using the Northwest Evaluation Association's Measures for Academic Progress (science), (c) students' pre-post science aspirations and goals using the Modified Attitude Toward Science Inventory, (d) teachers' fidelity of implementation using the Teaching Science as Inquiry instrument, and (e) classroom interactions using the Science Teacher Inquiry Rubric, and the Reformed Teaching Observation protocol. To interpret the main three levels of data (students, nested in teachers, nested within schools), hierarchical linear modeling (HLM), including HLM6 application, are utilized. An advisory board, including experts in research methodologies, science, informal science education, assessment, and measurement oversees the progress of the study and provides guidance to the research team. An external evaluator assesses both formative and summative aspects of the evaluation component of the scope of work.
The key outcome of the study is a research-informed and field-tested intervention implemented under specific conditions for enhancing middle school science learning and teaching, and supported by partnerships between formal and informal organizations.
Imagine two seventh-grade students from communities of color and low socioeconomic backgrounds, of whom at least one is an English-language learner1 (ELL). Both are likely disenfranchised from avenues to success and the ability to see themselves as capable of great things. These students attend school in the largest school districts in Colorado. As part of their seventh-grade science class, they participate in a program called Urban Advantage Metro Denver (UA Denver), which provides them the opportunity to work on a self-selected science project. Their projects are inspired by field trips to
If we wish to attempt an initial analysis of the inquiry on the communication of science in Brazil, India and China that JCOM proposed in its three most recent issues, we should paraphrase Chinese science and science-fiction writer, Yan Wu: even though these three countries are emerging in the fields of economy and science, and are now part of a wide group of communicators, promoting numerous methods to divulge information, they don't yet have a sound theory on the communication of science to the public. This is not an insignificant problem because according to David Dickson, the director of
ResearchLink: Spotlight on Solar Technologies was a Collaborative Research Connecting Researchers and Public Audiences (CRPA) Project led by the Oregon Museum of Science and Industry and Portland State University, funded by the NSF AISL program from 2012-2014. This poster was presented at the 2014 AISL PI Meeting in Washington, DC.
DATE:
TEAM MEMBERS:
Portland State University and Oregon Museum of Science and IndustryLauren (Russell) MorenoCarl Wamser
This CRPA award will address the science behind solar energy, its capture, measurements, and uses. It is a collaborative effort between scientists at Portland State University (PSU) and the Oregon Museum of Science and Industry (OMSI). Materials for the OMSI staff will be prepared by the scientists and the OMSI staff will work with the scientists on making presentations to the public. OMSI will translate information from the exhibits, displays, and presentations into Spanish to engage the Hispanic population. Scientific café?s will be part of this engagement. The PI and OMSI museum have had a working relationship for some time adding to the potential success of the project. The PI and his colleagues at PSU have a major effort going in research on photonic science suggesting that this engagement can continue to be updated as the time goes on. The project will be evaluated by the well established evaluation group at OMSI. Further, Spanish speaking public will be embraced with this material as will rural residents from traveling exhibits and displays.