During this session at the 2013 Visitor Studies Association Annual Conference the authors discussed our preliminary framework for addressing the question of how to evaluate an evaluation. The three-part framework—(1) Worth of the Intervention, (2) Appropriateness of the Evaluation Study, and (3) Usefulness for Stakeholders—comprises a set of criteria for evaluating summative evaluations. The authors shared early impressions from in-progress work on practical applications of the framework, solicited feedback on the framework, and brainstormed ideas for innovative evaluation tools and measures
Research on cultural cognition suggests that members of the public process science-related information by assessing its coherence with values and commitments that connect them to important affinity groups. This suggests a two-channel science communication strategy that combines information content with cultural meanings selected to promote open-minded assessment of information across diverse groups. Hear about this research and explore public engagement strategies for improving science communication followed by Q & A.
The National Girls Collaborative Project (NGCP) seeks to maximize access to shared resources within projects and with public and private sector organizations and institutions interested in expanding girls’ participation in science, technology, engineering, and mathematics (STEM). Funded primarily by the National Science Foundation, the NGCP is a robust national network of more than 3,000 girl-serving STEM organizations. Currently, 31 Collaboratives, serving 40 states, facilitate collaboration between more than 12,800 organizations who serve more than 7.7 million girls and 4.4 million boys. The NGCP occupies a unique role in the STEM community because it facilitates collaboration with all stakeholders who benefit from increasing diversity and engagement of women in STEM. These stakeholders form Regional Collaboratives, who are connected to local girl-serving STEM programs. Regional Collaboratives are led by leadership teams and advisory boards with representatives from K-12 education, higher education, community-based organizations, professional organizations, and industry. NGCP strengthens the capacity of girl-serving STEM projects by facilitating collaboration among programs and organizations and by sharing promising practice research, program models, and products through webinars, collaboration training, and institutes. This is accomplished through a tested comprehensive program of change that uses collaboration to expand and strengthen STEM-related opportunities for girls and women. In each replication state, the NGCP model creates a network of professionals, researchers, and practitioners, facilitating collaboration within this network, and delivering high-quality research-based professional development. Participating programs can also receive mini-grant funding to develop collaborative STEM-focused projects. To date, over 27,000 participants have been served in 241 mini-grant projects, and over 17,000 practitioners have been served through in-person events and webinars. The NGCP’s collaborative model changes the way practitioners and educators work to advance girls’ participation in STEM. It facilitates the development of practitioners in their knowledge of good gender equitable educational practices, awareness of the role of K-12 education in STEM workforce development, and mutual support of peers locally and across the United States.
The National Federation of the Blind (NFB), with six science centers across the U.S., will develop, implement, and evaluate the National Center for Blind Youth in Science (NCBYS), a three-year full-scale development project to increase informal learning opportunities for blind youth in STEM. Through partnerships and companion research, the NCBYS will lead to greater capacity to engage the blind in informal STEM learning. The NCBYS confronts a critical area of need in STEM education, and a priority for the AISL program: the underrepresentation of people with disabilities in STEM. Educators are often unaware of methods to deliver STEM concepts to blind students, and students do not have the experience with which to advocate for accommodations. Many parents of blind students are ill-equipped to provide support or request accessible STEM adaptations. The NCBYS will expose blind youth to non-visual methods that facilitate their involvement in STEM; introduce science centers to additional non-visual methods that facilitate the involvement of the blind in their exhibits; educate parents as to their students' ability to be independent both inside and outside the STEM classroom; provide preservice teachers of blind students with hands-on experience with blind students in STEM; and conduct research to inform a field that is lacking in published material. The NCBYS will a) conduct six regional, two-day science programs for a total of 180 blind youth, one day taking place at a local science center; b) conduct concurrent onsite parent training sessions; c) incorporate preservice teachers of blind students in hands-on activities; and d) perform separate, week-long, advanced-study residential programs for 60 blind high school juniors and seniors focused on the design process and preparation for post-secondary STEM education. The NCBYS will advance knowledge and understanding in informal settings, particularly as they pertain to the underrepresented disability demographic; but it is also expected that benefits realized from the program will translate to formal arenas. The proposed team represents the varied fields that the project seeks to inform, and holds expertise in blindness education, STEM education, museum education, parent outreach, teacher training, disability research, and project management. The initiative is a unique opportunity for science centers and the disability population to collaborate for mutual benefit, with lasting implications in informal STEM delivery, parent engagement, and teacher training. It is also an innovative approach to inspiring problem-solving skills in blind high school students through the design process. A panel of experts in various STEM fields will inform content development. NCBYS advances the discovery and understanding of STEM learning for blind students by integrating significant research alongside interactive programs. The audience includes students and those responsible for delivering STEM content and educational services to blind students. For students, the program will demonstrate their ability to interface with science center activities. Students will also gain mentoring experience through activities paired with younger blind students. Parents and teachers of blind students, as well as science center personnel, will gain understanding in the experiences of the blind in STEM, and steps to facilitate their complete involvement. Older students will pursue design inquiries into STEM at a more advanced level, processes that would be explored in post-secondary pursuits. By engaging these groups, the NCBYS will build infrastructure in the informal and formal arenas. Society benefits from the inclusion of new scientific minds, resulting in a diverse workforce. The possibility for advanced study and eventual employment for blind students also reduces the possibility that they would be dependent upon society for daily care in the future. The results of the proposed project will be disseminated and published broadly through Web sites; e-mail lists; social media; student-developed e-portfolios of the design program; an audio-described video; and presentations at workshops for STEM educators, teachers of blind students, blind consumer groups, researchers in disability education, and museum personnel.
The Girls RISEnet project convened an international community to explore the role of science centers in issues of gender equity in STEM learning. This effort resulted in two major products, including this international literature review that synthesizes what is known about how science centers and museums contribute to girls' engagement with STEM, summarizes what is useful for practice, and identifies gaps in the research. In addition, an international survey identified common global themes and issues and began to outline opportunities for science centers and museums to advance gender equity.
In November 2012, ASTC asked its science center and museum members to submit annual on-site attendance data for calendar years 2002 to 2011. One hundred fifty-five science centers and museums responded; 107 of those provided data for all 10 years. The goal of the survey was to collect consistent, long-term data to try to determine if there has been a clear upward or downward trend. Attendance increased overall from 2002 to 2009, but declined somewhat in 2010 and 2011. Large institutions showed the flattest attendance across the years.
DATE:
TEAM MEMBERS:
Association of Science-Technology Centers
This nationwide study sought to detect and evaluate the shifting priorities of today's attractions visitors and how their needs and wants drive their behavior. The data revealed trends in how people view, plan for, and react to their world as they travel throughout the country. The research compares recent findings to pre-recession studies to track key shifts in consumer behavior in the post-recession era.
This report is the result of a project to investigate through a sociocultural lens whether girls-only, informal STEM experiences have potential long-term influences on young women's lives, both in terms of STEM but also more generally. The authors documented young women's perceptions of their program experiences and the ways in which they influenced their future choices in education, careers, leisure pursuits, and ways of thinking about what science is and who does it. This report includes the questionnaire used in the study.
This report combines the views of education researchers, technology developers, educators, and researchers in emerging fields such as educational data mining and technology-supported evidence-centered design to present an expanded view of approaches to evidence. It presents the case for why the transition to digital learning warrants a re-examination of how we think about educational evidence. The report describes approaches to evidence-gathering that capitalize on digital learning data and draws implications for policy, education practice, and R&D funding.
DATE:
TEAM MEMBERS:
U.S. Department of EducationOffice of Educational Technology
This report addresses findings from the Bilingual Exhibit Research Initiative (BERI), a National Science Foundation-‐funded project (NSF DRL#1265662) through the Advancing Informal STEM Learning (AISL) program. This Pathways (planning grant) project was a 3-‐year project designed to better understand current practices in bilingual exhibitions and Spanish-‐speaking visitors’ uses and perceptions of bilingual exhibitions. Responding to a lack of extensive evaluation or audience research in informal science education (ISE) bilingual interpretation, the Bilingual Exhibit Research Initiative
In February 2013, the Atomic Heritage Foundation (AHF) brought together historians, sociologists and other scholars, as well as museum directors and thought leaders from the informal science education field to engage in a two-day discussion to explore ways to engage the public in the topic of the development of the atomic bomb in the context of history, society and culture. The workshop, titled "Transforming the Relationship Between Science and Society: The Manhattan Project and Its Legacy," had as its overarching goal to identify how the Manhattan Project might best be interpreted in a
Rockman et al (REA), a San Francisco-based research and evaluation firm, conducted the summative evaluation of the Sea Change website. Through funding from the National Science Foundation, Dan Grossman Media developed this website as part of Dr. Maureen Raymo's research. Her research looks at the Pliocene era (thought to be the most recent time in geologic history with a concentration of CO2 in the atmosphere with levels as high as today). The aim of the Sea Change website is to raise awareness about global-warming-induced sea level rise and how scientists study it. This report follows a