Even in the best-resourced science communication institutions, poor quality evaluation methods are routinely employed. This leads to questionable data, specious conclusions and stunted growth in the quality and effectiveness of science communication practice. Good impact evaluation requires upstream planning, clear objectives from practitioners, relevant research skills and a commitment to improving practice based on evaluation evidence.
Access to high quality evaluation results is essential for science communicators to identify negative patterns of audience response and improve outcomes. However, there are many good reasons why robust evaluation linked is not routinely conducted and linked to science communication practice. This essay begins by identifying some of the common challenges that explain this gap between evaluation evidence and practice. Automating evaluation processes through new technologies is then explicated as one solution to these challenges, capable of yielding accurate real-time results that can directly
King et al. [2015] argue that ‘emphasis on impact is obfuscating the valuable role of evaluation’ in informal science learning and public engagement (p. 1). The article touches on a number of important issues pertaining to the role of evaluation, informal learning, science communication and public engagement practice. In this critical response essay, I highlight the article’s tendency to construct a straw man version of ‘impact evaluation’ that is impossible to achieve, while exaggerating the value of simple forms of feedback-based evaluation exemplified in the article. I also identify a
AAAS describes public engagement with science as intentional, meaningful interactions that provide opportunities for mutual learning between scientists and members of the public. Through the Alan I. Leshner Leadership Institute for Public Engagement with Science, AAAS empowers scientists and engineers to practice high-impact public engagement by fostering leaders who advocate for critical dialogue between scientists and the public and lead change to enable their communities, institutions, and others to support public engagement. This bibliography, with additional work on understanding
Wallace and Brooks examined the culture of an elementary science education methods course conducted in a summer science camp, along with the professional identity development of the preservice teachers during their participation in the course.
Recent years have brought a shift in the rhetoric of science communication from initial deficit models to practices involving dialogue and, finally, engagement. But to what extent has this rhetorical shift changed practice in the U.K.? Jensen and Holliman analysed practitioners’ views of their science communication practices. Findings indicate that science communication practice is still primarily deficit-based, with some incidence of dialogue-oriented thinking.
How do people make sense of conflicting beliefs? Although Gottlieb & Wineburg’s paper is about highly educated professionals reading history, informal science educators will recognize similar issues when working with people who hold beliefs incompatible with scientific ways of understanding the world. “Epistemic switching” was a way of considering criteria for truth, reliability, and validity according to one belief system or another. Rather than simply believing or excluding ideas as people who held to only one value system, the people with multiple, competing affiliations actually more
How can technology be used to support inquiry in the classroom? In this study, Rehmat and Bailey probe the effects of a science methods course for preservice elementary teachers that explicitly includes technology integration. The preservice teachers in this course broadened their definition of classroom technology, increased their technology use, and gained a more positive outlook on technology integration.
The new standards posit that “scientific argumentation,” in which students use data to argue from evidence, is a key practice for student science learning. However, a mismatch in expectations about the purpose of classroom discussions can inhibit productive forms of argumentation. Berland and Hammer compare forms of class discussions to identify how best to support students’ engagement in argumentation.
Flying Higher will develop a permanent hands-on exhibit that conveys the fundamentals of flight, technology, materials science, and NASA’s role in aeronautics for learners ages 3-12 years and their parents/caregivers and teachers. The exhibit, public programs, school and teacher programs, and teacher professional development will develop a pipeline of skilled workers to support community workforce needs and communicate NASA’s contributions to the nation and world. An innovative partnership with Claflin University (an historically black college) and Columbia College (a women’s liberal arts college) will provide undergraduate coursework in informal science education to support pre-service learning opportunities and paid employment for students seeking careers in education and/or STEM fields. The projects goals are:
1) To educate multi-generational family audiences about the principles and the future of aeronautics; provide hands-on, accessible, and immersive opportunities to explore state-of-the-art NASA technology; and demonstrate the cultural impact of flight in our global community.
2) To provide educational standards-based programming to teachers and students in grades K–8 on NASA-driven research topics, giving the students opportunities to explore these topics and gain exposure to science careers at NASA; and to offer teachers support in presenting STEM topics.
3) To create and implement a professional development program to engage pre-service teachers in presenting museum-based programs focused on aeronautics and engineering. This program will provide undergraduate degree credits, service learning, and paid employment to students that supports STEM instruction in the classroom, explores the benefits of informal science education, and encourages post-graduate opportunities in STEM fields.
This research oriented project integrates the informal and formal science education sectors, bringing their combined resources to bear on the critical need for well-prepared and diverse urban science teachers. It represents a partnership among The City College of New York (CCNY), the New York Hall of Science (NYHOS), and the City University of New York Center for Advanced Study in Education (CUNY-CASE). It integrates the Science Career Ladder, a sustained program of informal science teaching training and employment at the NYHOS, with the CCNY science teacher preparation program. The longitudinal and comparative research study being conducted is designed to examine and document the effect of this integrated program on the production of urban science teachers. Outcomes from this study include a new body of research related to the impact of internships in science centers on improving classroom science teaching in urban high schools. Results are being disseminated to both the informal science education community (through the Association for Science and Technology Centers and the Center for Informal Learning in Schools, an NSF supported Center for Learning and Teaching situated at the San Francisco Exploratorium) and the formal education community (through the National Science Teachers Association and the American Educational Research Association).
The Science Career Ladder program engages undergraduates as inquiry-based interpreters (Explainers) for visitors to the NY Hall of Science. Integrating this experience with a formal teacher certification program enables participants to coordinate experiences in the science center, college science and education classes, and K-12 classrooms. Participants receive a license to teach science upon graduating. The approach has its theoretical underpinnings in the concept of situated learning as noted by Kirshner and Whitson (1997, Situated Cognition: Social, Semiotic and Psychological Perspectives, Mahwah, NJ: Erlbaum). Through apprenticeship experiences, situated learning recreates the complexity and ambiguity of situations that learners will face in the real world. Science centers provide a potentially ideal setting for situational learning by future teachers, allowing them to develop, exercise and refine their science teaching and learning skills as noted by Gardner (1991, The Unschooled Mind, New York: Basic Books).
There is a well-documented shortage of science teachers in urban school districts. The causes of this shortage relate to all phases of the teacher professional continuum, from recruitment through training and retention. At the same time, the demographic composition of American teachers is increasingly out of synch with the demographics of the student population, raising concerns that a critical shortage of role models may be at hand, contributing to a worsening situation in urban schools. In the face of these challenges many innovative teacher recruitment and teacher preparation programs have been developed to augment traditional pathways to teaching. These programs range from high school academies for students expressing an interest in teaching to the recruitment and training of individuals making mid-life career changes. The CLUSTER program described above represents a new alternative. There are more than 250 science centers in the United States. Many of these have extensive youth internship programs and collaborative relationships with local colleges. Therefore, the proposed model is widely applicable.
Since the summer of 2006, the Nature Museum at Grafton (TNM) has been offering three day intensive courses in Nature Writing and Nature Journaling. In 2006-07, TNM worked with PEER Associates to develop and analyze a survey which teachers complete on the last day of their course. TNM has continued to use that evaluation method, and, in December 2008 and February 2010, asked past participants to answer follow up questions about their future interest in programming options, experiences with the institutes, and their implementation of course content in their own classrooms. In late 2010, TNM