This funder reflection was provided to stimulate conversation at the June 20-21, 2013 CAISE Evaluation Convening. It describes the importance of evaluation to funders, and provides some prompts and questions for thinking about evaluation with relation to funding.
Libraries across the country have been reimagining their community role and leveraging their resources and public trust to strengthen community-based learning and foster critical thinking, problem solving, and engagement in STEM. What started some years ago as independent experiments has become a national movement. The Space Science Institute's National Center for Interactive Learning (NCIL), in partnership with the Lunar and Planetary Institute (LPI), received funding from the National Science Foundation for the first-ever Public Libraries & STEM conference, at the Sheraton Denver Downtown
Science and technology are embedded in virtually every aspect of modern life. As a result, people face an increasing need to integrate information from science with their personal values and other considerations as they make important life decisions about medical care, the safety of foods, what to do about climate change, and many other issues. Communicating science effectively, however, is a complex task and an acquired skill. Moreover, the approaches to communicating science that will be most effective for specific audiences and circumstances are not obvious. Fortunately, there is an
DATE:
TEAM MEMBERS:
National Academies of Sciences, Engineering, and Medicine
Youth environmental education (EE) programs often serve as gateway experiences in which diverse audiences engage in informal science learning. While there is evidence that these programs can have positive impacts on participants, little empirical research has been conducted to determine what makes one program more successful than another. To be able to conduct such research, this Exploratory Pathways study will (1) develop and statistically validate ways to measure meaningful outcomes for participants across a variety of programs and (2) test observational methods that will enable research that can determine which elements of program delivery most powerfully influence participant engagement and learning outcomes in different contexts. These efforts will include consultations with diverse subject matter experts from the National Park Service, nature centers, and academia; survey research with participants in afterschool and free-choice EE programs; and observations of EE programs designed to fine tune the measurement of program delivery elements and student engagement. Developing valid and reliable outcomes measures and observational protocols will enable a larger investigation that will specifically address the following research question: What program characteristics lead to the best learning outcomes for program participants in different contexts? This research will result in empirically tested guidelines that will enable educators to design and deliver more effective programs for a wide range of audiences in a wide range of contexts. It is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. This effort will refine methods necessary to undertake an unprecedented study (and future AISL Research in Service to Practice proposal) to examine the linkages between pedagogical approaches, participant engagement, and learning outcomes in informal STEM-focused youth EE programs. The larger study will involve systematically observing a large number of programs to assess the use of different approaches and to link those approaches to engagement and learning outcomes through both observation and survey research. In this current study the team will develop and refine crosscutting outcome measures to ensure validity, reliability, and sensitivity by drawing upon the literature and consultation with key stakeholders to develop suites of indicators for subsequent psychometric testing and revision. They will also refine observational techniques for assessing pedagogical approaches through extensive testing of inter-rater reliability. Finally, techniques for measuring participant engagement, incorporating both observational techniques and retrospective participant surveys will be refined. The work will be conducted by researchers at Clemson University and Virginia Tech, in partnership with the U.S. National Park Service, the North American Association for Environmental Education, and the American Association of Nature Center Administrators. This work represents the first step in a longer research process to determine the "best practices" most responsible for achieving outcomes in a wide range of contexts.
This project had three objectives to build knowledge with respect to advancing Informal STEM Education:
Plan, prototype, fabricate, and document a game-linked design-and-play STEM exhibit for multi-generational adult-child interaction utilizing an iterative exhibit design approach based on research and best practices in the field;
Develop and disseminate resources and models for collaborative play-based exhibits to the informal STEM learning community of practice of small and mid-size museums including an interactive, tangible tabletop design-and-play game and a related tablet-based game app for skateboarding science and technology design practice;
Conduct research on linkages between adult-child interactions and game-connected play with models in informal STEM learning environments.
Linked to these objectives were three project goals:
Develop tools to enable children ages 5-8 to collaboratively refine and test their own theories about motion by exploring fundamental science concepts in linked game and physical-object design challenge which integrates science (Newton’s Laws of Motion) with engineering (iterative design and testing), technology (computational models), and mathematics (predictions and comparisons of speed, distance, and height). [Linked to Objectives 1 & 3]
Advance the informal STEM education field’s understanding of design frameworks that integrate game environments and physical exhibit elements using tangibles and playful computational modeling and build upon the “Dimensions of Success” established STEM evaluation models. [Linked to Objectives 1 & 2]
Examine methods to strengthen collaborative learning within diverse families through opportunities to engage in STEM problem-based inquiry and examine how advance training for parents influences the extent of STEM content in conversations and the quality of interactions between caregivers and children in the museum setting. [Linked to Objectives 1 & 3]
The exhibit designed and created as a result of this grant project integrates skateboarding and STEM in an engaging context for youth ages 5 to 8 to learn about Newton’s Laws of Motion and connect traditionally underserved youth from rural and minority areas through comprehensive outreach. The exhibit design process drew upon research in the learning sciences and game design, science inquiry and exhibit design, and child development scholarship on engagement and interaction in adult-child dyads.
Overall, the project "Understanding Physics through Collaborative Design and Play: Integrating Skateboarding with STEM in a Digital and Physical Game-Based Children’s Museum Exhibit" accomplished three primary goals. First, we planned, prototyped, fabricated, and evaluated a game-linked design-and-play STEM gallery presented as a skatepark with related exhibits for adult-child interaction in a Children's Museum.
Second, we engaged in a range of community outreach and engagement activities for children traditionally underserved in Museums. We developed and disseminated resources for children to learn about the physics of the skatepark exhibit without visiting the Museum physically. For example, balance board activities were made portable, the skatepark video game was produced in app and web access formats, and ramps were created from block sets brought to off-site locations.
Third, we conducted a range of research to better understand adult-child interactions in the skatepark exhibit in the Children's Museum and to explore learning of physics concepts during physical and digital play. Our research findings collectively provide a new model for Children's Museum exhibit developers and the informal STEM education community to intentionally design, evaluate, and revise exhibit set-up, materials, and outcomes using a tool called "Dimensions of Success (DOS) for Children's Museum Exhibits." Research also produced a tool for monitoring the movement of children and families in Museum exhibit space, including time on task with exhibits, group constellation, transition time, and time in gallery. Several studies about adult-child interactions during digital STEM and traditional pretend play in the Museum produced findings about social positioning, interaction style, role, and affect during play.
DATE:
-
TEAM MEMBERS:
Deb DunkhaseKristen MissallBenjamin DeVane
The Wild Center will partner with Adirondack Museum, Cornell’s Maple Program, and New York State/Northeastern New York Maple Producers Associations to build regional identity, revitalize a heritage industry, and connect people to nature through the art, story, history, and science of maple sugaring. The Northern New York Maple Project will create interpretative exhibits with ecological, historical, and economic information. The museum will develop an instructional maple sugaring video; a touch-screen story kiosk that lets visitors share stories through the exhibit and social media; a storytelling workshop for staff, project partners, and maple producers; community events and conferences; a school education program; community sugaring workshops; and educational materials, website, social media, and outreach to industry, food enthusiasts, and the business community. Regular planning meetings on goals and deliverables will track results and an outside consultant will evaluate the overall success of the project.
This paper investigated the potential of the Public Internet Terminal (PIT) system to promote basic health education for two rural communities in the North West Province of South Africa. A case study approach was used. Participants were selected from a population group of teachers, nurses, business people and students in the two communities. Observation, group interviews and questionnaire were used to gather evidence from the participants regarding their operational difficulties, social/economic difficulties and perceived usefulness of using the PIT system for basic health education. The
The science education community is buzzing about STEM learning ecosystems, ecologies of learning, and ecological perspectives on learning. You may not know it, but if your teaching involves building on young people’s prior knowledge or making connections between the science curriculum and science in the broader world, your work may already reflect aspects of ecological learning theories. At the heart of an ecological perspective on learning is the need to make connections across formal, informal, and everyday learning. So, what are STEM learning ecologies all about, and how can science
My dream—many would call it a fantasy—is that someday, science will be as pervasive in society as sports. We already have professional science, but imagine the day that we have extensive programs that feature intramural science, after-school science, and that pick-up science activity at the local park. Passionate amateur scientists will exist in abundance: more amateur geologist rock collectors, more amateur paleontologist fossil collectors, more amateur astronomers who write research papers with professional astrophysicists, and more citizen science projects that provide critical data to
The connections among neuroscience, educational research, and teaching practice have historically been tenuous (Cameron and Chudler 2003; Devonshire and Dommett 2010). This is particularly true in public schools, where so many issues are competing for attention—state testing, school politics, financial constraints, lack of time, and demands from parents and the surrounding community. Teachers and administrators often struggle to make use of advances in educational research to impact teaching and learning (Hardiman and Denckla 2009; Devonshire and Dommett 2010). At the Franklin Institute, we
Omaha’s Henry Doorly Zoo and Aquarium has been a strong and active partner in education for over 40 years, educating 1.7 million visitors annually. The zoo has become a leader in both informal and formal education by pioneering many science, technology, engineering, and mathematics (STEM) initiatives. In 1996 the zoo moved from being a partner with others to becoming a true collaborator with a diverse group of education institutions. The zoo discovered that a successful partnership requires multiple organizations to come together and share resources for a cause. In partnering with school
Within the UNAM (The National Autonomous University of Mexico) there is an institution, the Dirección General de Divulgación de la Ciencia (DGDC) devoted to the popularization of science through different media such as museums, exhibitions, journals, books, radio and TV programs, internet, workshops for children, demos, shows, plays, summer courses and outreach programs. Most of these products and materials are planned, designed and manufactured by a multidisciplinary team of professionals in the DGDC. Some of our most outstanding projects are: the creation and operation of two science museums