EvalFest (Evaluation Use, Value, and Learning through Festivals of Science and Technology) will test innovative evaluation methods in science festivals that are being held across the country and assess in what ways and how effectively they are used. Morehead Planetarium and Science Center (at the University of North Carolina-Chapel Hill) and the University of California, San Francisco, in collaboration with over twenty science festivals, will (1) investigate whether a multisite evaluation approach is an effective model for creating common metrics for informal STEM education, (2) develop common methods to measure the effects of Festivals, (3) create a query-able database of 50,000 Festival attendees to share with the informal STEM learning field, and (4) document whether these efforts also result in new knowledge related to informal STEM education. The project will develop the Enterprise Feedback Management (EFM) system and query-able database for the festival community. EFMs are systems, including processes and software, that enable groups (such as the festival network) to collect, organize, analyze and share data. The EFM system will be designed to integrate data across sites and to allow users to extract data of interest. The project will refine evaluation tools currently used within the Science Festival Alliance that assess self-reported festival learning, and the effects of festival attendance, motivation, and future science participation. It will collect economic impact data and longitudinal festival attendee data. The project will also develop some new evaluation tools such as secret shopper observational protocols. Data from festival attendees will be collected onsite at participating festivals.
This project will bring STEM education to rural communities through local public libraries. Museum quality exhibits labelled as "Discover Earth", "Discover Technology", and "Discover Space" will spend 3 months at a series of locations around the Nation. Twenty four medium sized libraries will be chosen for the large exhibits and forty small libraries will be chosen for scaled down versions. The project's intent is to provide exhibits in every state and to reach as many under-represented individuals as possible. The significance of this project is that rural areas of this country are underserved regarding STEM education and since this segment of society is represented by 50-60 million residents, it is important to reach out to them. There is a significant segment of the Nation's population (50-60 million) that is underserved by out-of-school learning venues such as museums and science centers. An earlier phase 1 project demonstrated at 18 sites that rural libraries and librarians could provide STEM education to community members ranging in age from adults to children using these hands-on exhibits. Each exhibit (earth, space or technology) includes information about the topic and technologically enabled models to provide interesting and fun discovery mechanisms. They use common layman friendly language that highlights the most recent discoveries in each area. Each exhibit will be placed in the selected library for 3 months during which the library will organize events to feature and advertise the STEM learning opportunities. Another feature of this project will be to determine the models of learning in library settings and as a function of the demographics. The partners in this project that bring the necessary expertise are the American Library Association, the Afterschool Alliance, the Association of Rural and Small Libraries, the University of Colorado Museum, Datum Advisors, LLC, Evaluation and Research Associates, the Lunar and Planetary Institute, the American Geophysical Union, and the Space Science Institute.
The Designing Our World (DOW) project centers on science, technology, engineering, and mathematics (STEM) equity and addresses the need for more youth, especially girls, to pursue engineering and fill vital workforce gaps. DOW will integrate tested informal science education (ISE) programs and exhibits with current knowledge of engaging diverse youth through activities embedded in a social context. Led by teams of diverse community stakeholders and in partnership with several local girl-serving organizations, DOW will leverage existing exhibits, girls’ groups, and social media to impact girls’
DATE:
TEAM MEMBERS:
Oregon Museum of Science and IndustryAnne Sinkey
This is the Front End Evaluation report for the NSF-AISL-funded Pushing the Limits: Building Capacity to Enhance Public Understanding of Math and Science through Rural Libraries (Limits) project. A national survey of rural librarians and their patrons was carried out between February and April 2011. Key guiding questions were: 1) How interested/motivated are rural librarians in: a. Providing science and technology related programming at their libraries; b. Participating in professional development for running public programs; c. Personally learning about science and technology topics. 2) How
DATE:
TEAM MEMBERS:
Dartmouth CollegeJohn H FalkJennifer BachmanMichael Liu
This project is intended to develop a model for STEM education through local libraries. There are several unique features in this endeavor. The model is being aimed at rural libraries and adult residents that are geographically remote from typical venues such as museums, zoos, and science centers. According to the 2000 census, there are 50 million individuals in this designation and the size of the group is increasing and becoming more diverse. Efforts to impact diverse audiences who are economically disadvantaged will be part of the plan. In many rural locations there are few community venues, but libraries are often present. The American Library Association and the Association Rural and Small Libraries have begun the reinvention of these libraries so they can become more attuned to the communities in which they are apart. Thus, this project is an effort to find new ways of communicating STEM concepts to a reasonably large underserved group. The design is to derive a "unit of knowledge enhancement" (some portion of Climate Change, for example) through a hybrid combination of book-club and scientific cafe further augmented with videos and web materials. Another part of the design is to enhance the base STEM knowledge of library staff and to associate the knowledge unit with an individual who has the specific STEM topic knowledge for a specific unit. Considerable effort shall be expended in developing the models for staff knowledge enhancement with a progressive number of librarians in training from 8 to 20 to 135. To build the content library model, five units of knowledge will be devised and circulated to participating libraries. Evaluation of the project includes front end, formative and summative by the Goodman Research Group. In addition to the "units of knowledge enhancement," the major results will be the model on how best to relate and educate citizens in rural environments and how to educate the library staff.
As part of its overall strategy to enhance learning in informal environments, the Advancing Informal STEM Learning (AISL) program funds innovative resources for use in a variety of settings. Nationally, the US has a shortage of computer scientists; a big part of this problem is that girls are discouraged from learning computer science at a very young age. This project tries to address this problem by creating a videogame specifically oriented towards getting middle school girls interested in learning computer science concepts outside traditional programming classes. Based on evidence that stories provide a compelling way to present complicated technical subjects and that girls in particular respond to technology careers as a way to help others, the project is building a videogame called "Gram's House" in which social workers intend to move a fictional grandmother to a retirement home unless the player can outfit her home with sufficient technology for her to remain independent. Solving puzzles in the game requires learning core computer science concepts. Research studies will be conducted to determine whether the videogame is effective at getting girls interested in computer science, at teaching computer science concepts, and whether using stories makes videogames more effective for learning. This project based on an earlier successful prototype uses an iterative research-based design process including paper prototyping, playtesting, and focus groups (N=20) to create age appropriate activities, based on the CS Unplugged series, that support learning concepts from the Data, Internet, Algorithms, and Abstraction sections of the high-school level CS Principles curriculum. A quantitative, quasi-experimental design will be used to determine the overall effectiveness of teaching CS concepts under three types of game conditions: (a) games alone, (b) games with fictional settings, and (c) games with stories. A novel assessment instrument will be developed to assess content learning and qualitative observation using a standard observation protocol will be used to gauge interest and engagement. 70-80 middle school girls will be recruited for afterschool participation in the study in two states. As part of the dissemination efforts, a facilitator's guide, rule book, and materials such as maps and storyboards will be created and shared with the game. In addition, a workshop for computer science and other teachers who are interested in using games to teach CS concepts will be conducted.
Many communities across the country are developing "maker spaces," environments that combine physical fabrication equipment, social communities of people working together, and educational activities for learning how to design and create objects. Increasingly, maker spaces and maker technologies are being designed to provide extended learning opportunities for school-aged young people. Unfortunately, few youth from under-represented populations have had the opportunity to participate in these maker spaces, and many communities do not have the resources to establish facilities dedicated to making activities. This project, a collaboration of faculty at California State University, San Marcos and San Diego County Office of Education, the Vista Unified School District, and the San Diego Fab Lab, is a feasibility study that will work to address these needs by implementing and evaluating a pilot Mobile Making program in an underserved youth population. It will bring Making to four after-school programs in underserved communities in San Diego by using a van to take both equipment and undergraduate student mentors to program sites. At these sites, between 50% and 90% of the students are Hispanic or Latino and between 40% and 90% are eligible for free or reduced price lunch. The project employs a research-based approach to the design and implementation of the Mobile Making program, coupled with an evidenced-based plan for developing a model for future dissemination. Project objectives are: increasing the participants' interest, self-efficacy, and perception of the relevance of Making/STEM in everyday life; identifying and overcoming challenges associated with a Mobile Making program; developing a model for implementing and assessing Mobile Making in underserved communities; and disseminating materials and guides for practitioners. Development will be guided by five research-based principles for design of out-of-school time programs in underserved communities: access to resources; ethnically diverse near-peer leaders; authentic activities; legitimacy within the community; and ongoing input from participants. To inform program development and implementation, including continuous monitoring and adjustment throughout the two-year initiative, the evaluation component will use a mixed methods approach to study outcomes with respect to the students, their parents and the undergraduate mentors. Future work will apply the lessons learned in the project to guide implementations and study the model's applicability in other informal education settings. The dissemination plan will include publication of project findings, activities, practitioner's guides, and the model for implementing making programs in underserved communities.
DATE:
-
TEAM MEMBERS:
Edward PriceCharles de Leone
resourceevaluationWebsites, Mobile Apps, and Online Media
The UMass Donahue Institute (UMDI) was contracted to provide formative evaluation services for WGBH’s PEEP and the Big Wide World project development of curriculum units and instructional modules for use by family child care providers (FCCPs). This formative study piloted three 3-week curriculum units focused on three science content areas, integrated with media and professional development materials for family child care settings (videos and a Facilitator’s Guide for trainers) in English and in Spanish. This report describes the methodology used to implement this study and the findings from
DATE:
TEAM MEMBERS:
WGBH Educational FoundationUniversity of Massachusetts, Donahue
This poster was presented at the 2014 AISL PI Meeting in Washington, DC. Madison Area Technical College, in collaboration with the Institute for Chemical Education at the University of Wisconsin-Madison, the American Chemical Society (ACS) and area science centers and museums will create a national program to disseminate the Fusion Science Theater (FST) model which directly engages children in playful, participatory, and inquiry-based science learning of chemistry and physics topics.
This poster was presented at the 2014 AISL PI Meeting in Washington, DC. The Community Collaborative Rain, Hail and Snow (CoCoRaHS) network is an existing backyard citizen science project that is enhancing the research efforts of scientists and promoting climate literacy among the public by engaging volunteers in precipitation-monitoring activities.
This poster describes the work accomplished by August 2014 for the NSF-funded project "Science of Sharing: Investigating Cooperation, Competition, and Social Interdependence." It was presented at the 2014 AISL PI Meeting in Washington, DC.
The mission of the New Mexico Informal Science Education Network (NM ISE Net) is to provide opportunities and resources for informal educators to work together to impact science teaching, science learning, and science awareness throughout the state of New Mexico. The NM Museum of Natural History and Science leads NM ISE Net with support from NM EPSCoR.
DATE:
-
TEAM MEMBERS:
New Mexico Museum of Natural HistorySelena ConnealyCharlie Walter