In this paper we investigate how people become engaged with open data, what their motivations are, and the barriers and facilitators program participants perceive with regard to using open data effectively.
DATE:
TEAM MEMBERS:
Jack ShanleyCamillia MatukOded NovGraham Dove
resourceevaluationProfessional Development, Conferences, and Networks
This document is the final evaluation report for the Teen Science Cafes for Advancing STEM in Rural Places project.
A Teen Science Café is a free, regularly occurring event during the school year in which a local scientist, engineer, or STEM expert discusses their field experiences with the teen attendees. Ideally, a Teen Leader cohort, under the mentorship of an Adult Leader, organizes and implements each Café.
The Teen Science Café Network is a community of practice linking the various youth-serving organizations, institutions, community settings, and individuals that host Teen Science
The Science Festival Alliance (SFA) is a professional association of independent science and technology festivals. We are dedicated to supporting both new and existing festivals, and to fostering an international conversation about how to make public science events more meaningful, entertaining, and instructive.
This annual report provides information in two distinct categories:
1) member activities—the accomplishments of the independently organized science festivals that comprise SFA membership; and
2) network activities—SFA efforts that support the exchange of inspiration, advice, and
The Art of Science Learning, Phase 2 was an NSF-funded research and development project to investigate the value of incorporating arts-based learning techniques in STEM-related group innovation processes. The project team created a new, arts-infused innovation curriculum in consultation with leading national practitioners in the arts, creativity, and innovation, then deployed that curriculum in “innovation incubators” in San Diego, Chicago, and Worcester (Mass.) in partnership with informal STEM institutions in those cities. At each incubator, diverse members of the public (from high school
DATE:
TEAM MEMBERS:
Peter LinettSteve ShewfeltNicole BaltazarNnenna OkekeDreolin FleisherEric LaPlantMadeline SmithChloe Chittick PattonSarah LeeHarvey Seifter
This poster was presented at the 2016 Advancing Informal STEM Learning (AISL) PI Meeting held in Bethesda, MD on February 29-March 2. EvalFest is a community of practice designed to test innovative evaluation methods across 24 Science Festivals to measure their impact.
The Balboa Park Cultural Partnership, in collaboration with several informal science education and other cultural and business organizations in San Diego, Chicago, and Worcester, MA are implementing a research and development project that investigates a range of possible approaches for stimulating the development of 21st Century creativity skills and innovative processes at the interface between informal STEM learning and methods for creative thinking. The goal of the research is to advance understanding of the potential impacts of creative thinking methods on the public's understanding of and engagement with STEM, with a focus on 21st Century workforce skills of teens and adults. The goal of the project's development activities is to experiment with a variety of "innovation incubator" models in cities around the country. Modeled on business "incubators" or "accelerators" that are designed to foster and accelerate innovation and creativity, these STEM incubators generate collaborations of different professionals and the public around STEM education and other STEM-related topics of local interest that can be explored with the help of creative learning methodologies such as innovative methods to generate creative ideas, ideas for transforming one STEM idea to others, drawing on visual and graphical ideas, improvisation, narrative writing, and the process of using innovative visual displays of information for creating visual roadmaps. Hosting the project's incubators are the Balboa Park Cultural Partnership (San Diego), the Museum of Science and Industry (Chicago) and the EcoTarium (Worcester, MA). National partners are the Association of Science-Technology Centers, the American Association for the Advancement of Science, and the Americans for the Arts. Activities will include: the formation and collaborative processes of three incubator sites, a research study, the development of a creative thinking curriculum infused into science education, professional development based on the curriculum, public engagement events and exhibits, a project website and tools for social networking, and project evaluation. A national advisory council includes professionals in education, science, creativity, and business.
EvalFest (Evaluation Use, Value, and Learning through Festivals of Science and Technology) will test innovative evaluation methods in science festivals that are being held across the country and assess in what ways and how effectively they are used. Morehead Planetarium and Science Center (at the University of North Carolina-Chapel Hill) and the University of California, San Francisco, in collaboration with over twenty science festivals, will (1) investigate whether a multisite evaluation approach is an effective model for creating common metrics for informal STEM education, (2) develop common methods to measure the effects of Festivals, (3) create a query-able database of 50,000 Festival attendees to share with the informal STEM learning field, and (4) document whether these efforts also result in new knowledge related to informal STEM education. The project will develop the Enterprise Feedback Management (EFM) system and query-able database for the festival community. EFMs are systems, including processes and software, that enable groups (such as the festival network) to collect, organize, analyze and share data. The EFM system will be designed to integrate data across sites and to allow users to extract data of interest. The project will refine evaluation tools currently used within the Science Festival Alliance that assess self-reported festival learning, and the effects of festival attendance, motivation, and future science participation. It will collect economic impact data and longitudinal festival attendee data. The project will also develop some new evaluation tools such as secret shopper observational protocols. Data from festival attendees will be collected onsite at participating festivals.
This paper presents a summary of each of 10 evaluations conducted of NASA educational programs. The paper begins with a table outlining the titles of the evaluations and who conducted them, the date of the report, the evaluation questions, the evaluation design or methods and brief comments on the quality of each report. After the table each report is considered in more depth through an overview of what the evaluation included as well as a critique of the evaluation questions, methods and findings. The paper concludes with an overall commentary on the set of evaluations.
The 2012 Science Festival Alliance Annual Report is now available. This first-of-its-kind document provides a snapshot of activity for the SFA and its members in 2012, and it paints quite a striking picture. With 13 SFA member festivals (membership has grown since!) reporting on the over 1,600 events they produced in 2012 the numbers add up quickly. How many of these events drew more that 1,000 visitors? What percent of attendees gave the events evaluated positive ratings? Read on to find out, and notice that certain sections of the report, such as our list of a few festival news stories, are
This broader implementation project will create a professional network of individuals and institutions increasing their capacity to develop, implement, and evaluate the impact of large scale community science festivals. The project builds on a previous award that supported the implementation of science festivals in Cambridge, MA; San Francisco, San Diego, and Philadelphia. Each festival reached 50-70,000 attendees, many of them families from low-income, ethnic communities. Festival organizers and participants include science center practitioners, Science, Technology, Engineering and Mathematics (STEM) researchers, STEM related businesses, public television STEM producers, universities, K-12 schools, and government and foundation stakeholders. The summative evaluation indicated significant impacts on participant's STEM interest, learning, and connections to STEM resources in their community. The number of science festivals across the country is increasing. Consequently this new project will create a professional network with numerous benefits to professionals in the Informal Science Education (ISE) field and other stakeholders including: timely access to information, knowledge and experience related to science festivals; rich relationships to draw on when facing challenges; credibility of the festival concept; ability to partner with multiple festivals and magnify the reach of existing ISE institutions and program; diffusion of knowledge and innovation; and collective intelligence and inclusive consultation. It is expected that the network will involve supporting approximately 50 science festivals during the grant period. A business plan will be developed for long term sustainability of the network and the subsequent growth of science festivals. This is a collaborative proposal with 4 project partners who have distinct roles in creating and sustaining the network: MIT, University of California at San Francisco, University of North Carolina/Morehead Planetarium and Science Center, and The Franklin Institute. MIT's project deliverables include hosting the central management and administrative functions of the network and providing conferences, workshops, individual mentoring of new science festival champions, maintaining the network website, etc. UCSF will develop tools, resources, and linkages to increase participation of scientists in festivals. UNC/Morehead Planetarium and Science Center will provide expertise in statewide festival organizing. The Franklin Institute will help network participants build capacity for engaging low-income families with programming examples, community asset analysis tools, and webinars. This multi-hub approach is a new innovative strategy for creating and sustaining the first ever professional network for science festival organizers. The project evaluation will focus on the network\'s vibrancy, connectivity and effect. Network vibrancy impact data will be collected on how members share goals, enhance leadership, and expand geographic and model diversity. Network connectivity evaluation will study the strength and growth of the relationships within the SFA network. Network effects will study the ways the Science Festival Alliance (SFA) network is achieving science festival organizational capacity looking at increases in the number of science festivals, geographic spread, science festival innovations, and the presence of a SFA sustainability plan. This project will add new knowledge about the impact of networks on the development and impact of science festivals throughout the country.