From April 19 to June 15, 2009, volunteers had the opportunity to provide feedback on their volunteer experience and offer suggestions for improvement. The survey was initially only available as a web-based survey. Volunteers with email accounts were sent a link to the survey. Those volunteers without an email address were asked to contact Volunteer Services for a paper copy of the survey. Volunteers received an hour of volunteer time for completing the survey. Of the 369 active volunteers, a total of 144 filled out the survey for a 39% response rate (compared to 46% in 2008 and 41% in 2007)
From May 1 to July 7 of 2008, volunteers had the opportunity to provide feedback on their volunteer experience and offer suggestions for improvement. The survey was a follow up to the May 2007 volunteer survey. The 2008 survey was initially only available as a web-based survey. Volunteers with email accounts were sent a link to the survey. A kiosk was also available in the volunteer check-in area for volunteers to complete the survey while at the museum. After the first month, the survey was made available in paper format in the volunteer break room to help increase the response rate. Paper
DATE:
TEAM MEMBERS:
Sarah CohnScience Museum of Minnesota
In May 2007, self-administered surveys about their volunteer experience and training were sent to 552 Science Museum of Minnesota volunteers, and 224 volunteers filled it out and returned it for a 41% response rate. The responses from volunteers to many questions were lengthy and detailed; a separate appendix is attached containing all of the commentary provided by volunteer respondents to open-ended questions on the survey. The survey is also included in the appendix. In this summative report, selections of sample responses were included after open-ended questions. Principal Findings 1. A
ExhibitFiles is an online community for exhibit practitioners developed by the Association of Science-Technology Centers (ASTC) with funding from the National Science Foundation (NSF). The website provides an infrastructure for sharing and building knowledge about exhibition development and design practices. After testing, the site officially opened on April 23, 2007. Influenced by learning theories such a Wenger's community of practice (1998) and Web 2.0 concepts, the project team incorporated site features and management strategies to develop and extend the professional networks and the
DATE:
TEAM MEMBERS:
Carey TisdalAssociation of Science-Technology Centers
The ASTA Group, LLC (ASTA) received EAGER funding (National Science Foundation (NSF) Grant No. 094077) to conduct comprehensive planning for a National Initiative on Cyberlearning in K-12 Education. To ensure success, ASTA invited a diverse group of experts and stakeholders to participate in the planning process. Planning tasks included individual meetings and combined planning sessions. The planning process culminated with a 1-day workshop to synergize the preliminary information collected. ASTA produced a Summary Report synthesizing participants' ideas and recommendations to guide the
Veridian inSight performed an evaluation study in fall of 2009 to evaluate the effectiveness of an online training developed as an outreach component of the FETCH! with Ruff Ruffman series (http://pbskids.org/fetch/). The FETCH! Hands-On Science Training was designed for anyone who wants to lead science activities with elementary-age kids (including after-school providers, teachers, camp counselors, librarians, museum staff, parents, and others). The goals of the evaluation study were to assess the extent to which the FETCH! training was successful at:· Preparing afterschool educators
In 2005, the Vermont Center for the Book (VCB) received funding from the National Science Foundation (NSF) to develop and implement a program called What's the BIG Idea? to help librarians change their children's story hours to include more mathematics and science content and vocabulary. The project resulted in the creation of a professional development seminar; a Librarian Manual with guidelines, activities and other information; parent kits for families to take home and use to reinforce and extend learning in math and science; and a website filled with ideas, bibliographies, and other
DATE:
TEAM MEMBERS:
Dawn JaramilloJudy NorthupShelley H. BilligVermont Center for the Book
August, 2009 Communities of Effective Practice, 2008-2009 Evaluation Abstract: The Communities of Effective Practice (CEP) project is a National Science Foundation (NSF)-funded project to develop a professional development model for supporting math and science instructional practices that are culturally responsive within American Indian communities. This report summarizes findings from the Year 3 evaluation (conducted during the 2008-2009 academic year) and discusses these findings within the context of the Years 1 and 2 evaluations. It presents key considerations for developing a Community
DATE:
TEAM MEMBERS:
Gina MaghariousKasey McCrackenUtah State University
This report highlights the findings from Inverness Research's summative study of the TEAMS III Collaborative. In particular, it highlights the lessons learned from a study to incorporate research on how to design exhibits that promote more effective conversations into the exhibit development process.
FETCH with Ruff Ruffman is a daily half-hour PBS television series with accompanying Web and outreach activities targeted to 6- to 10-year olds. The program brings science learning to young children by uniquely blending live-action with animation, game show convention with reality programming, and humor with academics. The intended impacts are to 1) help the target audience develop interest, knowledge and skills necessary to do science; 2) train afterschool leaders to better facilitate science activities with kids; and 3) demonstrate how media can be used to teach substantive science and share the results of project evaluation with others in the field. The requested funds will allow the project to expand the science curriculum with 20 new half-hour episodes and expand the Web site, focusing on three new science themes that highlight topics of interest to this age group. The Web site will include four new science-based Web games that will allow kids to create and post content of their own design and contribute to nationwide data collection. A new FETCH Online Training resource will be created to help afterschool leaders to effectively engage in FETCH's hands-on science activities. American Institutes for Research (AIR) will conduct summative evaluation of the Online Training program.
The Institute for Learning Innovation, in collaboration with Mary Miss Studio and the Institute for Urban Design, is conducting an exploratory research and development project on sustainable practices related to the built infrastructure of New York City. The work will (1) pilot test and study new interpretive strategies for urban "place-based" public learning experiences that focus pedestrians' attention on a city's ecology and existing built sustainability infrastructure; (2) engage urban design professionals and STEM researchers to explore how these new strategies have the potential to transform how urban design fields inform, dialog and interact with the public about sustainable urban design and planning; and (3) assess the effectiveness of these public interpretation programs on STEM learning beyond traditional Informal Science Learning Environments (ISEs) such as science museums. Project participants also include faculty from the City College of NY Graduate Program in Urban Design, STEM faculty from Columbia University, and staff of the Provisions Library in Washington, D.C. The project is an early phase of the "City as Living Laboratory" initiative that can leverage the Rockefeller Foundation-funded Urban Design Week program in New York City scheduled to occur September 15 - 20, 2011. This request to NSF adds an additional track to the process to specifically focus on STEM learning and urban sustainability. From the promotional materials: "The Institute for Urban Design is currently preparing for the first annual Urban Design Week, a public festival created to engage New Yorkers in the fascinating and complex issues of the public realm and celebrate the city's exceptional urbanity. Through a rich roster of charettes, summits, installations, film screenings, exhibitions, and tours, Urban Design Week will draw in citizens from every borough and walk of life and highlight the idea that cities are made by collective effort, and that each of us can be a part of that great endeavor." The project goal is to generate new models for public engagement with science in the city environment and to explore how urban designers and planners, as they design for sustainability, can more effectively collaborate with STEM researchers and with the public. The project has both research and programmatic deliverables. Research activities include: Public Audiences: observational study of pedestrians in the installation environment; intercept surveys of the public about their experiences with the streetscape installations. Professional Audiences: pre-installation surveys on the role of public space science interpretation for altering public discourse about urban planning and sustainable cities; focus group assessment of professionals' experiences with observing public interactions with the installations; online delayed- post experience survey on learning outcomes in terms of knowledge, attitude, motivation and anticipated impacts on professional practices; analysis of blog postings and public media surrounding the installation; survey of attendees at an ISE forum on the project, its goals, outcomes and potential for future developments. Programmatic deliverables include: a workshop that engages urban design students in the development of experimental streetscape installations; a pilot installation on streets in the City College of NY (consistent with approvals already received by NYC Dept. of Transportation); a City as Living Laboratory art-science workshop for Urban Design Week professionals to highlight possible benefits of inter-disciplinary collaboration; a panel discussion around new forms of citizen engagement through a "city as a science learning environment"; a forum specifically for ISE professionals to explore the research findings and potential for use as a strategy to increase science learning in city places.
This broader implementation project will create a professional network of individuals and institutions increasing their capacity to develop, implement, and evaluate the impact of large scale community science festivals. The project builds on a previous award that supported the implementation of science festivals in Cambridge, MA; San Francisco, San Diego, and Philadelphia. Each festival reached 50-70,000 attendees, many of them families from low-income, ethnic communities. Festival organizers and participants include science center practitioners, Science, Technology, Engineering and Mathematics (STEM) researchers, STEM related businesses, public television STEM producers, universities, K-12 schools, and government and foundation stakeholders. The summative evaluation indicated significant impacts on participant's STEM interest, learning, and connections to STEM resources in their community. The number of science festivals across the country is increasing. Consequently this new project will create a professional network with numerous benefits to professionals in the Informal Science Education (ISE) field and other stakeholders including: timely access to information, knowledge and experience related to science festivals; rich relationships to draw on when facing challenges; credibility of the festival concept; ability to partner with multiple festivals and magnify the reach of existing ISE institutions and program; diffusion of knowledge and innovation; and collective intelligence and inclusive consultation. It is expected that the network will involve supporting approximately 50 science festivals during the grant period. A business plan will be developed for long term sustainability of the network and the subsequent growth of science festivals. This is a collaborative proposal with 4 project partners who have distinct roles in creating and sustaining the network: MIT, University of California at San Francisco, University of North Carolina/Morehead Planetarium and Science Center, and The Franklin Institute. MIT's project deliverables include hosting the central management and administrative functions of the network and providing conferences, workshops, individual mentoring of new science festival champions, maintaining the network website, etc. UCSF will develop tools, resources, and linkages to increase participation of scientists in festivals. UNC/Morehead Planetarium and Science Center will provide expertise in statewide festival organizing. The Franklin Institute will help network participants build capacity for engaging low-income families with programming examples, community asset analysis tools, and webinars. This multi-hub approach is a new innovative strategy for creating and sustaining the first ever professional network for science festival organizers. The project evaluation will focus on the network\'s vibrancy, connectivity and effect. Network vibrancy impact data will be collected on how members share goals, enhance leadership, and expand geographic and model diversity. Network connectivity evaluation will study the strength and growth of the relationships within the SFA network. Network effects will study the ways the Science Festival Alliance (SFA) network is achieving science festival organizational capacity looking at increases in the number of science festivals, geographic spread, science festival innovations, and the presence of a SFA sustainability plan. This project will add new knowledge about the impact of networks on the development and impact of science festivals throughout the country.