The Summative Study of the Nano Mini-exhibition took place during the spring and summer of 2012. After being observed during their Mini-exhibition experience, 455 visitors across six different partner institutions participated in surveys and interviews with NISE Net evaluation team members. This report begins by describing the key findings of the study in detail, with additional information about study methods, instruments, and two exploratory sub-studies found in the Appendices.
This Broad Implementation media project (building upon prior NSF award 0639001) will address science literacy among Latinos via mass media, increasing the amount of Spanish-language science content available in the U.S., increasing the representation of Latino scientists in mainstream media, and expanding the knowledge base about Latino's interest and engagement in science. The STEM content will be based on the research conducted by the Hispanic scientists being interviewed and therefore includes a wide range of topics including astronomy, biology, physics, earth sciences, and engineering. The criteria for selecting the Hispanic researchers and the content is based on the importance of the research, how it is immediately relevant to a Latino audience, and how it draws on the indigenous knowledge system or ethnic pride for U.S. Latinos. Project deliverables include 150 audio-video interviews with Hispanic scientists distributed on both commercial Hispanic radio and TV stations, as well as public broadcasting and online. In addition to the broadcasts, social media tools such as Facebook and Twitter will be used to reach out and engage Hispanics. It is estimated that 300 Spanish-language radio stations will air the programs, resulting in 3 million radio impressions for each daily 60-second broadcast. Television broadcasts are estimated to result in another 2 million impressions per program. Project partners include the Society for the Advancement of Chicanos and Native Americans in Science (SACNAS); V-Me, a national Hispanic educational channel; KLRN, the San Antonio, Texas public television station that will provide the national PBS distribution; and DaGama Web Studio that will develop and implement the social media marketing plan to attract and engage Latinos online. Comprehensive evaluations of project deliverables and impact will be conducted by Informal Learning Solutions (video-audio formative evaluations), and Knight-Williams Research (summative evaluation of project impact). The Summative Evaluation Plan will focus on the programs\' overall appeal, clarity, and effectiveness in meeting the two key audience objectives in the proposal: (1) increasing familiarity with and understanding of science concepts among U.S. Latinos, and (2) demonstrating engagement activities such as talking with friends/family about the presented topics, and/or seeking out additional information. It will furthermore assess the extent to which listeners and viewers find the Hispanic researchers featured in the programs to be effective communicators and the importance they assign to hearing from Hispanic researchers themselves. It will look at whether and how the programs are effective selecting topics with immediate relevance to listeners'/viewers' everyday lives. Finally, the evaluation will gather information about listeners'/viewers' demographic and background characteristics, including their country of origin, degree of fluency in Spanish, reasons for preferring Spanish media, number of generations in the U.S., reasons for tuning into the programming, efforts to recommend the programs to others, and the likelihood of continuing to listen to or view the programs in the future.
In Defense of Food (IDOF) is a media and outreach project based on Michael Pollan's best-selling book of the same title. Through the lens of food science, IDOF is designed to engage diverse audiences in learning about: (1) how science research is conducted, (2) how research findings are used in media, marketing, and public policy, and (3) how to apply food science research in everyday life. IDOF will be created by Kikim Media, an independent production company, broadcast and distributed by PBS and supported by an extensive outreach campaign and interactive website. The project's educational materials will be developed, in part, by the Teacher's College at Columbia University's Center for Food and Nutrition, with dissemination supported by the Coalition for Science After School and by Tufts University's Healthy Kids Out of School initiative, which involves nine of the leading out of school time (OST) organizations, such as Girl Scouts USA, and the National Urban League. The project advisory committee includes highly respected researchers in food, nutrition, and health. IDOF will use an integrated strategy of learning resources, combining a television documentary with online/social media, community outreach, and youth activities. Knight Williams Research Communications will conduct formative and summative evaluation of all major components of the project. The results will advance the informal science community's understanding of how the combination of a documentary with outreach, website/social media, and afterschool activities impacts motivation and learning. The evaluation study will pay special attention to the degree to which participation in the community events, social media/website, and afterschool activities motivates deeper or extended engagement with the subject. Project evaluation results and educational resources will be widely disseminated to the informal science community. IDOF includes a two-hour documentary film that will be produced in both English and Spanish; a community-level outreach campaign focused on reaching underserved audiences who may not watch public television; a set of activities for use in afterschool programs, youth programs and schools; and an interactive and content-rich website with tightly integrated social media tools. IDOF will be nationally broadcast by PBS; the Spanish-language version of IDOF will be broadcast by Vme Television. The ambitious IDOF educational materials and outreach campaign, combined with interactive web and social media, will reach large and diverse audiences. The intended impacts on audiences include increased knowledge and understanding of the scientific process by learning what food scientists do, what techniques they use, and how scientists arrive at their conclusions; the development of critical thinking skills audiences can use when evaluating messages about food and nutrition in media and advertising and when making decisions about what food to buy and eat; and becoming active learners and consumers regarding food. Evaluation results will be widely disseminated to science media producers and the informal science community via professional publications and presentations at conferences. The ultimate value of the In Defense of Food documentary and learning initiative will be to enhance public understanding of the crucial importance of science in people's everyday lives and in shaping dozens of daily decisions.
This proposed Communicating Research to Public Audiences (CRPA) project outlines a pathway for communicating how climate change can affect a watershed area that supplies water for a specific region. The educational platforms will address the geology of the Caldera along with meteorology, ecology and hydrology. The project will focus on the ongoing scientific research processes and the impact of climate change to the physical system as well as to the citizens who depend on this resource. Partners in this endeavor include New Mexico EPSCOR, the University of New Mexico, the Valles Caldera National Preserve, the New Mexico Museum of Natural History and Science, Santa Fe Productions and Tim Aydelott Productions. The project team will create a PBS television documentary in English and Spanish, including a Native American Jemez Pueblo storyteller who will describe the natural environment of the Caldera. The team will also create a YouTube channel with updatable clips, a Facebook fan page, and a climate change exhibit. The evaluation will include front-end and summative components, and will be conducted by Minnick & Associates and Elsa Bailey Consulting. The intended impact of this CRPA is to educate the public about the importance of the Caldera in securing the region's water supply and how climate changes could impact their lives. Further, aspects of the multidisciplinary science used in this research will be described with the goal of encouraging more young people from the region to choose STEM careers.
The Exploratorium, in collaboration with the Boys and Girls Club Columbia Park (BGC) in the Mission District of San Francisco, is implementing a two-year exploratory project designed to support informal education in science, technology, engineering, and mathematics (STEM) within underserved Latino communities. Building off of and expanding on non-STEM-related efforts in a few major U.S. cities and Europe, the Exploratorium, BGC, and residents of the District will engage in a STEM exhibit and program co-development process that will physically convert metered parking spaces in front of the Club into transformative public places called "parklets." The BGC parklet will feature interactive, bilingual science and technology exhibits, programs and events targeting audiences including youth ages 8 - 17 and intergenerational families and groups primarily in the Mission District and users of the BGC. Parklet exhibits and programs will focus on STEM content related to "Observing the Urban Environment," with a focus on community sustainability. The project explores one approach to working with and engaging the public in their everyday environment with relevant STEM learning experiences. The development and evaluation processes are being positioned as a model for possible expansion throughout the city and to other cities.
The Conservation Trust of Puerto Rico is creating citizen science projects in five research areas (insect monitoring; coastal/river system management; bird communities; bat assemblages; and cultural resources) that allow 140 Hispanic residents of Puerto Rico (age 14 and older) to move along a continuum of research involvement from contributor to collaborator to co-creator. As citizen scientists engage in scientific research that measures the effects of urban development on the Manati River watershed in northern Puerto Rico, the project team is evaluating the degree to which participants show changes in science knowledge, skills, attitudes, communication, and behavior. The proposed project is accelerating the development of citizen science activities in Puerto Rico. New scientific knowledge generated by citizen scientists will have practical importance within and beyond the Manati watershed because Puerto Rico is undergoing rapid urban development, resulting in the loss of biodiversity and emergence of environmental problems such as lower water quality. Environmental data collected by citizen scientists will form an environmental database that permits long-term watershed monitoring and informs land use decision making.
This CRPA award will address the science behind solar energy, its capture, measurements, and uses. It is a collaborative effort between scientists at Portland State University (PSU) and the Oregon Museum of Science and Industry (OMSI). Materials for the OMSI staff will be prepared by the scientists and the OMSI staff will work with the scientists on making presentations to the public. OMSI will translate information from the exhibits, displays, and presentations into Spanish to engage the Hispanic population. Scientific café?s will be part of this engagement. The PI and OMSI museum have had a working relationship for some time adding to the potential success of the project. The PI and his colleagues at PSU have a major effort going in research on photonic science suggesting that this engagement can continue to be updated as the time goes on. The project will be evaluated by the well established evaluation group at OMSI. Further, Spanish speaking public will be embraced with this material as will rural residents from traveling exhibits and displays.
This Pathways project from the Ocean Discovery Institute (ODI) seeks to develop and pilot a program model designed to fill an identified gap in citizen science research and practice literature: how to effectively engage and better understand how to foster participation among people from under-represented groups in citizen science research. The ODI model is designed around six principles: (1) leaders who are reflective of the community, (2) science that is locally relevant, (3) guided, as opposed to self-guided, experiences, (4) direct interactions with scientists, (5) progressively increasing responsibilities for participants who express interest, and (6) removing barriers to participation, such as transportation, language, family involvement and access to technology. The project addresses environmentally degraded, crime-ridden local canyons, a locally relevant STEM-related issue, and leverages the Southern California Coastal Water Research Project's (SCCWRP) regional citizen science effort focused on identifying the sources and pathways of trash through regional watersheds. The scientific research components of the project focus on four canyons in the area, employing sampling methods developed by SCCWRP. Youth who are part of other ODI programs and who have demonstrated leadership and interest in science, work with the project team to scaffold family and youth participation in project activities taking place during afterschool and weekend time. Based on continued participation in the project, community participants can become more involved in the project, starting as "new scientists" and moving through "returning scientists" to "expert scientists" roles. The project evaluation seeks to identify the role and importance of the components of the proposed model with respect to participation, retention, and learning by participants from groups under-represented in STEM. The dissemination products of this Pathways project include a white paper describing the model and lessons learned as well as presentations to community groups and education and citizen science practitioners. Based on insights from the iterative approach to the model during this Pathways study, a subsequent full-scale development project would seek to engage citizen science projects around the nation in adapting the model to increase participation of individuals from groups underrepresented in STEM, including building out ODI's citizen science programming.
DATE:
-
TEAM MEMBERS:
Lindsay GoodwinRoxanne RuzicTheresa Sinicrope Talley
During 2007, the Exhibits Department conducted a summative evaluation of Wild About Otters to document visitors' interest in and their responses to this temporary exhibition. This study was conducted in three parts to examine visitors' behaviors and responses to aspects of the exhibition, including conservation content, emotional reactions and bilingual graphic panels. Research questions 1. How are visitors using the exhibition? Which exhibits are they attending to and for how long? 2. What did visitors think Wild About Otters was about? 3. What conservation content did visitors remember
Throughout the year, El Museo del Barrio hosts various cultural programs that are open to the public and often free. To explore the effectiveness of the Museum's cultural programs, Randi Korn & Associates, Inc. (RK&A) conducted case studies for three programs Day of the Dead, Three Kings Day, and Super Sabado - Carnival. RK&A conducted naturalistic observations of visitors to the three programs. Trained data collectors unobtrusively observed program attendees and took notes on select behaviors using observation guides specific to each program. RK&A interviewed program participants 18 years and
DATE:
TEAM MEMBERS:
Randi Korn & Associates, Inc.El Museo del Barrio
The Oregon Museum of Science and Industry (OMSI) will partner with the City of Portland's Office of Sustainable Development, Metro Regional Government, Portland Community College, Verde, and the Coalition for a Livable Future, to create a series of informal science education experiences on the theme of Sustainability. For this project, sustainability is defined in terms of a triple bottom line of economic, social, and environmental needs. The project responds to calls for broad environmental education of the public in response to environmental crises (such as climate change), and specific research suggesting that even museums that do provide information about such issues rarely help their visitors learn to make the comparisons necessary to make more sustainable choices. For the public audience, the project team will create a 1,500 sq. ft. bilingual (Spanish/English) exhibition to encourage the public to develop skills in making personal choices that affect the sustainability of their community. They will also create 25-40 bilingual cell phone tags that will provide listeners who dial the phone numbers with information, personal perspectives, current STEM research, invitations to contribute ideas or vote on issues, interactive phone-based activities, and links to websites, all in service of helping them make intentional and informed personal decisions on sustainability. The cell phone tags will be located at approximately 100 locations in the Portland area, including predominantly Hispanic neighborhoods, public transit locations, public works, and community projects. The team will also create a bilingual website and will offer quarterly bilingual events at the museum on the topic of sustainable living. For the professional audience, the team will create a set of tools and indicators for assessing the sustainability of exhibit-development processes, using the triple bottom line of financial, environmental, and social impacts. For example, a Green Exhibit Guide will provide resources and a checklist for exhibit development projects, and will propose field-wide standards analogous to the LEED (Leadership in Energy and Environmental Design) rating system for green buildings. Regional workshops will engage exhibit developers, designers, fabricators, and administrators in using the tools in their own institutions. The project will create a coordinated set of resources to inform the public about the science of sustainability and to engage them in making informed choices in their daily lives, both in the museum and beyond. The topic of sustainability is timely and important, and the use of cell phones as a mobile technology linked to web resources and an exhibition constitute an innovative synergy of media to create impacts on a city-wide scale. The project serves underrepresented Hispanic audiences through its creation of bilingual materials, placement of cell phone tags, and community involvement in the development process. Finally, the project advances the ISE field in proposing and broadly disseminating a set of standards for green exhibit design, along with developing resources and tools for assessing sustainability. Created in collaboration with other organizations, this work has the potential to reduce the environmental impact of museums while providing highly visible examples of sustainable practices for visitors.
This full-scale development project would use a multi-platform approach (TV, Field School, and Web site) to engage public audiences and underserved youth in archaeology research and discovery. The project will advance knowledge and practice in the field of ISE by establishing the utility of archaeology as an entry point to multiple STEM fields showing how it answers important questions about human origins-culture, history, and the natural environment. The target audience includes a broad demographic of viewers who will watch the PBS broadcasts. The other key audience is underserved youth who will participate in the archeology digs and be featured in the national broadcast. They will engage other underserved youth who will have the opportunity to participate in the interactive online virtual field school. Primary organizational partners include the Crow Canyon Archaeology Center in Colorado and other archeology organizations at the 4 field sites. Deliverables include four hours of PBS programming filmed at four archaeological sites telling the stories of diverse cultures (Native American, African American, Hispanic); field schools designed for underrepresented youth both onsite and online; blogs, online discussions, and user-generated videos. The evaluation will determine the impact of the television series, online content, and the on-site Field School on audiences' understanding of, interest in, and interactions around STEM topics within the context of archaeology. Formative evaluation will provide input and help refine the television programs, web site, and field school. The summative evaluation will use a variety of methods and artifacts to determine the degree to which the process of the TV series, web site, and Field School was successful. The television programs are expected to reach 13 million viewers via broadcast, 300,000 via streaming video and 50,000 unique web site visitors. The lessons learned from this project will be disseminated to other media and ISE organizations.