During Fall 2008, the Science Museum of Minnesota's outreach staff visited schools throughout northern Minnesota to deliver the Energy Connections program. A summative evaluation was carried out to gauge the impact the program had on students' understanding of three of the program's key learning goals. As a result of participating in the Energy Connections program, students will learn that electrical energy can be generated from a variety of sources, which can be either renewable or non-renewable, and can have different environmental consequences/impact. People influence what decisions are
DATE:
TEAM MEMBERS:
Amy Grack NelsonClaire PhilippeScience Museum of Minnesota
The Learning Places evaluation went beyond the traditional approach of determining how well the project met its goals. In addition to that approach, we identified grounded theory. Five areas of theory and related hypotheses emerged: STEM learning, agents of change, teens as designers, community partner engagement and national collaboration. Each is described in detail in the full report, along with findings related to each of the project goals.
Columbia University Materials Research Science and Engineering Center (MRSEC) and New York Hall of Science (NYHOS) partnered to create Research and Rolling Exhibits (RARE). The project's goal is to showcase current research in science and make it accessible to the general public. Five Wondercarts were created over three years, from 2005 through 2008, highlighting topical scientific research and its relevance to the museum's target audience. The carts were programmed to engage families in conversation, letting their interest determine the direction of activities. In this manner Wondercarts
DATE:
TEAM MEMBERS:
Ellen GiustiNew York Hall of ScienceKathleen Condon
In 2008, Goodman Research Group, Inc. (GRG) conducted summative evaluation of Absolute Zero, a collaborative effort of the University of Oregon's Cryogenic Helium Turbulence Laboratory and Twin Cities Public Television. The films were produced by Meridian/Windfall Productions, Washington DC, and/Windfall Films in London, UK. Outreach was spearheaded by Devillier Communications, Inc. The Absolute Zero project was centered on a two-part documentary about low-temperature physics, which aired on PBS/NOVA in early January 2008, as well as an outreach campaign, which included approximately 20
DATE:
TEAM MEMBERS:
Irene GoodmanUniversity of OregonLaura HousemanMarianne McPherson
This Pathways Project connects rural, underserved youth and families in Eastern Washington and Northern Idaho to STEM concepts important in sustainable building design. The project is a collaboration of the Palouse Discovery Science Center (Pullman, WA), Washington State University and University of Idaho, working in partnership with rural community organizations and businesses. The deliverables include: 1) interactive exhibit prototype activities, 2) a team cooperative learning problem-solving challenge, and (3) take-home materials to encourage participants to use what they have learned to investigate ways to make their homes more energy-efficient and sustainable. The project introduces youth and families to the traditionally difficult physics concept of thermal energy, particularly as it relates to sustainable building design. Participants explore how building materials and their properties can be used to control all three types of heat transfer: conduction, convection, and radiation. The interactive exhibit prototypes are coupled with an Energy Efficient Engineering Challenge in which participants, working in cooperative learning teams, use information learned from the exhibit prototype activities to retrofit a model house, improving its energy efficiency. The project components are piloted at the Palouse Discovery Science Center, and then travel to three underserved rural/tribal communities in Northern Idaho and Eastern Washington. Front-end and formative evaluation studies will demonstrate whether this model advances participant understanding of and interest in STEM topics and careers. The project will yield information about ways that other ISE practitioners can effectively incorporate cooperative learning strategies in informal settings to improve the transferability of knowledge gained from exhibits to real-world problem-solving challenges, especially for rural and underserved audiences. This project will also provide the ISE field with: 1) a model for increasing the capacity of small, rural science centers to form collaborative regional networks that draw on previously unused resources in their communities and provide more effective outreach to the underrepresented populations they serve, and 2) a model for coupling cooperative learning with outreach exhibits, providing richer experiences of active engagement.
Design It! Building Design Challenges in After School Programs, funded by the National Science Foundation, is a collaboration between the Education Development Center (EDC), the National Institute for Out-of-School Time (NIOST) and science centers/museums and after school programs located in community-based organizations (CBOs) in six cities. The project's primary goal was to improve the quality of programming in after school programs by establishing long term relationships between science centers/museums and after school programs and developing, incorporating and institutionalizing hands-on
DATE:
TEAM MEMBERS:
Patricia CampbellEducation Development CenterLesley PerlmanEarl Hadley
The objective of this youth media project is to provide 14-24 year olds with training and hands-on experience in engineering, and the physical and biological sciences. The project is designed around core practices that engage youth in original research and inquiry through experimentation, development, and creative use of new technologies and tools to communicate STEM to the public. Youth Radio project participants in Oakland, CA, Atlanta, GA and Washington, DC include 540 youth, 80% of whom are low-income and/or youth of color, plus another 400 youth via off-site outreach in schools and community centers. Core deliverables include: (1) "Brains and Beakers," eight live events per year where a visiting STEM researcher brings his/her work out of the lab and onto the stage at Youth Radio facilities, demonstrating key principles and discoveries and interacting with youth participants; (2) "Youth Radio Investigates," an annual 6-part multimedia series, where youth partner with university and industry-based researchers to explore the veracity of scientific claims applied to products and services and they use every day; (3) The "Application Development Lab," where youth develop, create and disseminate online embeddable and downloadable applications (12 annually) that serve real needs in youth communities. The digital media produced by the youth will be broadcast by National Public Radio and distributed online through various sites including iTunes and BoingBoing.net, one of the most frequently visited technology-focused sites on the web. Project advisors include STEM researchers in universities as well as highly experienced and successful new media technology developers. Project partners include National Public Radio, KQED, the California Academy of Sciences, and the Oakland Unified School District. This project builds on the successful prior work (NSF #0610272) that initiated a Science and Technology program within the Youth Radio organization. The summative evaluation by Rockman et al will measure how the program affects students' science and technology knowledge, skills, and attitudes. It will build on the evaluation from the prior NSF funded project (#0610272) that highlighted the organizational and staff growth processes as Youth Radio discovered how to design and implement successful, sustainable STEM programs. Rockman will evaluate the new programs (Youth Investigates, Brains and Beakers, and the Application Lab), measuring the following STEM-related student outcomes/impacts: perceptions of selves as producers/creators of science or technology; attitudes toward science and perceptions of scientists; understanding the process of scientific inquiry and research and/or technology skills development; and understanding or interest in careers in science or technology (based on National Research Council report, 2009). Data will be collected from the youth at the Oakland site and from the other Youth Radio bureaus to determine which aspects of the program transfer to multiple sites and which ones are unique to a specific location or set of circumstances. Methods include surveys of student attitudes, participant focus groups, interim assessments, objective skills assessments, and interviews. This project provides an innovative new model for collaborations between STEM researchers and under-represented youth resulting in digital media that impacts the youth as well as the public's understanding and engagement in science.
The Nexus of Energy, Water, and Climate: From Understanding to Action (Café +) project will develop and test two interactive board game concepts focused on energy, water, and climate with youth and adults from four highly diverse communities in New Mexico. The four primary goals of the project are to: (a) develop, play test, and implement two board, card, or other non-electronic games grounded in energy, water, and climate content at four project sites, (b) identify the key characteristics of the games that maximize problem solving while stimulating interest, engagement, and learning, (c) explore the implications of game playing on dialog, learning, and Café+ satisfaction for youth and adult participants, and (d) evaluate the viability of this model for full scale implementation throughout the existing Café Scientifique program, from which this project is based. Los Alamos National Laboratory, Sandia National Laboratory, PNM Resources, Scott Balaban Games Design, the Los Alamos County Utilities Department, and a host of advisors and consultants from a broad range of organizations and institutions will collaborate to develop, test, and implement the Café+ games model. The primary deliverables include: (a) two non-electronic multiage commercial quality games focused on energy, water, and climate content, (b) a comprehensive pilot study examining the impact, effectiveness, and viability of the Café+ model with the target audiences, and (c) formative and summative evaluations of the games implementation model. A significant outcome of Café+ is that New Mexico youth and adults, from diverse backgrounds, will learn relevant science content through the development and testing of engaging, innovative commercial quality games. Over 250 youth and adults will benefit directly from their participation in the pilot study. They will not only learn important science content while working collaboratively in groups (youth only and youth/adult groups), but they will also participate in an authentic scientific process experience as playtesters. In this role, youth and adults will experience critical science concepts such as trial and error and refinement. Further, the games will be made publicly available and implemented across the entire Café Scientifique program (n=960 youth). The evaluation study will employ a mixed methods approach to examine project implementation, effectiveness, and impacts. Focus groups, observations, and surveys will be employed to assess a number of variables such as (but not limited to): content knowledge and learning, interest, engagement, game features, game play processes, gaming obstacles and challenges, participant interactions, and motivation. Embedded assessment opportunities will also examine participants\' decision making abilities, analytical skills, and ability to transfer knowledge gained to real world situations as they navigate through the games. Data collected at the youth-only pilot test sites will be used in a comparative analysis of similar variables tracked at the youth and adult sites. Formative approaches will provide iterative, ongoing opportunities for programmatic and game refinement and adjustments. The formative and summative evaluations will endeavor to document critical data and findings needed to assess the viability of Café+ as a full scale development project, with additional games and project sites across the country. The Café+ project would add to the limited literature base on learning and science engagement of youth within Science Café settings in the 21st century. More critically, this pilot study could contribute to the dearth of current research on the impact of non-electronic game play can have on youth only groups and youth/adult groups working collaboratively to make important scientific decisions within Science Café settings. This comparative data could prove significant for other program models interested in implementing similar youth and adult game based program. Further, the relevance of the content could potentially spark youths' interest not only in pursuing courses and careers in STEM, but it could also motivate youth and adult participants to become more involved in civic engagement activities occurring within and beyond their local communities.
The Fusion Science Theater National Training and Dissemination Program builds on the success of the Fusion Science Theater (FST) planning grant (DRL 07-32142). Madison Area Technical College, in collaboration with the Institute for Chemical Education at the University of Wisconsin-Madison, the American Chemical Society (ACS) and area science centers and museums will create a national program to disseminate the FST model which directly engages children in playful, participatory, and inquiry-based science learning of chemistry and physics topics. The primary target audience is children aged 4-11, while undergraduate chemistry students, faculty, and formal and informal educators comprise the secondary professional audience. The project will result in the development of a robust, creative, and highly visible national dissemination program. The National Training and Dissemination Program includes three deliverables. First, a Distance Performance Training Program will be developed to teach groups of undergraduate students, faculty, and educators how to perform FST Science Investigation (SI) Shows. The Training Program includes a Performance Training Package and a 3-day Performance Training Workshop. The Performance Training Package will be comprised of training videos, performances videos, scripts, rehearsal schedules, and training exercises. These materials will be pilot tested while training representatives of five groups from around the country to perform SI Shows during the Performance Training Workshop at Madison Area Technical College in summer 2012. Participants will be selected from ACS undergraduate groups, outreach specialists, and museum professionals. Workshop participants then return to their home institutions and lead their groups through the improved Performance Training Package delivered via Moodle, with support from FST team members and social networking tools. The second deliverable is the FST Methods Workshop. The Methods Workshop is designed to teach formal and informal educators to use selected methods (Investigation Question, Embedded Assessment, and Act-It-Out) in their outreach efforts and classroom teaching. Four workshops will be presented at national meetings and at the invitation of colleges, universities, and science centers. Follow-up with workshop participants will be mediated through an online forum to encourage experimentation, modification, and dissemination of a second generation of FST activities. The final project deliverable is the development and implementation of a Promotion and Recruitment Plan to connect professional audiences with FST. The Distance Performance Training Program and workshops will be evaluated using mixed methods, while embedded assessment will be utilized to measure the impact on youth participants attending SI shows to determine the overall effectiveness the Distance Performance Training. This project is designed to have important impacts on STEM education and society. The proposed dissemination program brings innovative models and methods into the hands of informal science education practitioners who can use them to engage local audiences and enhance their own teaching and communication practices. Finally the project offers likely benefits for society through the creation and dissemination of innovative practices to combat science illiteracy, diminishing pools of scientists and engineers, lack of understanding about the nature of science, and the achievement gap that exacerbates these problems. This project could be transformative in informal science education as SI Shows use theater to engage audiences in multiple aspects of science learning. It is anticipated that this project will reach up to 2,500 individuals in public and professional audiences.
Madison Area Technical College will refine and evaluate the effectiveness of Fusion Science Theater (FST), a combination of theater, science demonstrations, and participatory components, as an ISE teaching model, to test its transferability through development and trials of an exportable version (Science-in-a-Box), and to recruit appropriate partners nationally in preparation for a larger scale implementation and evaluation. A Fusion Science Theater event utilizes the collaborative effort of applied expertise in science, theater and education. These events support playful interactions as characters engage the emotions of the audience. The Act-It Out sequences invite children and parents to become involved in modeling scientific concepts, thus creating an environment where learning is the product of social interaction and kinesthetic, affective and interpersonal learning. To provide proof-of-concept that this a transferable model, an independent, interdisciplinary team from the University of Wisconsin, Madison Biotechnology Center will produce their own FST event that will be evaluated and compared to an existing FST program. The Madison Children's Museum will partner as a venue for the event and provide expertise in the planning process. The ultimate project resulting from this planning would include workshops to train collaborative teams from around the country in the principles and practices of FST, promotion of cross-disciplinary collaboration among professionals, and honing of an evaluation design for FST events. The trained teams would then produce FST events that reach children, their parents and the general public. The planning grant project design includes activities necessary to further test, verify and document Fusion Science Theater events. It provides a proof of concept of model effectiveness and transferability. It also initiates, develops and assesses ways to train other groups to implement the model and publicizes the model to national professional networks to spread the work and recruit site teams.
Cosmic Serpent - Bridging Native and Western Science Learning in Informal Settings is a four-year collaboration between the Indigenous Education Institute and the University of California-Berkeley targeting informal science education professionals. This project is designed to explore the commonalities between western science and native science in the context of informal science education. The intended impacts are to provide informal science education professionals with the skills and tools to gain an understanding of the commonalities between native and western worldviews; create regional networks that bridge native and museum communities; develop science education programs in which learners cross cultural borders between western science and indigenous peoples; and meet the needs of diverse audiences using culturally-responsive approaches to science learning. Participants are introduced to topics in physical, earth, space, and life science, using an interdisciplinary approach. Deliverables include professional development workshops, peer mentoring, museum programs for public audiences, a project website, and media products for use in programs and exhibits. Additionally, regional partnerships between museums and native communities, a legacy document, and a culminating conference jointly hosted by the National Museum of the American Indian and the Association of Science and Technology Centers will promote future sustainability. Strategic impact is realized through participants' increased understanding of native and western science paradigms, museum programs that reflect commonalities in the two approaches, partnerships between museums and native communities, and increased institutional capacity to engage native audiences in science. This project directly impacts 270 informal educators at 96 science centers and tribal/cultural museums nationally while the resulting programs will reach an estimated 200,000 museum visitors.
The California Science Center will develop an exhibition, "Abracadabra: The Science of Illusion." This will be a 6000-sq.ft. traveling exhibit. The theme, the science behind magic, will help visitors understand that magic is based on the complex interplay between sensation, perception, physical science and math concepts, culture, and the art of performance. The goal of the exhibition is to use the public's fascination with magic as a bridge to learning basic science in the area of optics, electromagnetics, simple mechanics, math, physiology and psychology. The exhibit will include seven thematic sections and an enclosed theater for live and taped performances. The exhibition will open at the California Science Center in October, 2000 and then will travel to the six science centers that participate in the Science Museum Exhibit Collaborative. It is estimated about 4 million people will view the exhibition during its national tour.