The Dimensions of Success (DoS) observation tool defines and provides rubrics (with levels 1-4) for 12 dimensions that were developed to measure STEM program quality in out-of-school time. This technical report summarizes the development of the instrument and findings from our initial study that included 284 observations in the field across 58 STEM programs in two geographic regions (New England and the Midwest). Data were collected by 46 trained observers who observed in pairs. This report is the initial step in developing a validity argument for the instrument.
DATE:
TEAM MEMBERS:
Ashima Mathur ShahCaroline WylieDrew Gitomer
The Dimensions of Success observation tool, or DoS, pinpoints twelve indicators of STEM program quality in out-of-school time. It was developed and studied with funding from the National Science Foundation (NSF) by the Program in Education, Afterschool and Resiliency (PEAR), along with partners at Educational Testing Service (ETS) and Project Liftoff. In 2014, a technical report was released, describing the tool and its psychometric properties (http://www.pearweb.org/research/pdfs/DoSTechReport_092314_final.pdf). The DoS observation tool focuses on understanding the quality of a STEM activity in an out-of-school time learning environment and includes an explanation of each dimension and its key indicators, as well as a 4-level rubric with descriptions of increasing quality. Today, over 700 people have been trained to use the DoS tool, and over 12 state networks have adopted DoS to measure the quality of their afterschool STEM programming.
DATE:
-
TEAM MEMBERS:
Program in Education, AfterschoolDr. Ashima ShahDrew Gitomer
Life on Earth is interactive software installed as a museum touchtable exhibit that uses data about over seventy thousand (70,000) species from several databases to help visitors explore and deepen their understanding of biodiversity, evolution and common ancestry, and the history of life on earth (DeepTree/ FloTree). Some installations also include a smaller exhibit that poses puzzle challenges about evolutionary relationships among species (Build-a-Tree (BAT)). The exhibit was installed at four natural history museums across the U.S. – the Harvard Museum of Natural History (Cambridge, MA)
DATE:
TEAM MEMBERS:
Harvard UnivesityJim HammermanAmy SpiegelJonathan Christiansen
Interactive surfaces are increasingly common in museums and other informal learning environments where they are seen as a medium for promoting social engagement. However, despite their increasing prevalence, we know very little about factors that contribute to collaboration and learning around interactive surfaces. In this paper we present analyses of visitor engagement around several multi-touch tabletop science exhibits. Observations of 629 visitors were collected through two widely used techniques: video study and shadowing. We make four contributions: 1) we present an algorithm for
Plum Landing (https://pbskids.org/plumlanding/) is produced by WGBH Educational Foundation (http://wgbh.org), the Public Broadcasting Service affiliate based in Boston, MA. The website, Plum Landing, follows the adventures of an animated space alien, named Plum, after her spaceship crash-lands on Earth. With funding from the National Science Foundation, the Corporation for Public Broadcasting, The Kendeda Fund, and the Northern Research Station, Forest Service, U.S. Department of Agriculture. WGBH worked closely with a panel of science advisors to create an “innovative, environmental science
This is a report of an evaluation of the content and design of the science components of the Education Development Center's TV411 program, conducted by Owen Consulting, Inc. In 2010, EDC received a grant from NSF to reconstruct the TV411 website, produce new science content, including videos and web lessons, improve user interactivity, and develop materials to support adult educators who work with the site's target population of low literacy adults. This report lays out the evaluation design, provides an overview of site web metrics, describes the registered user population discusses the ways
DATE:
TEAM MEMBERS:
Education Development CenterEric GraigDavid Owen
How can professional learning for out‐of‐school staff be organized to promote equity in STEM learning? This is the question a group of out-of‐school educators and educational researchers gathered to discuss at the Exploratorium on January 30‐31, 2015. The meeting was sponsored by the Research+Practice Collaboratory, an NSF-‐funded project that develops and tests new models for integrating research and practice perspectives for the improvement of science and mathematics education. Four big ideas for supporting equity-oriented facilitation emerged from the group's discussions: (1) Seeing
This book offers museum learning researchers and practitioners--educators, explainers, and exhibit developers--a new approach for fostering group inquiry at interactive science exhibits. The Juicy Question game, developed at the Exploratorium in San Francisco, engages group members in a simple process of inquiry that helps them work together interrogate exhibit phenomena more deeply. and widens their both families and student field trip groups. The approach is easy to implement and yields clear results. The results are summarized in a set of practice principles that can be used by other
On June 20-22, 2008, the Philadelphia/Camden Informal Science Education Collaborative (PISEC) conducted the Bridges Conference for museum/community partnership programs that serve families. The conference was funded by a National Science Foundation (NSF) grant (DRL# 0734835), which covered planning, implementation, evaluation and dissemination. The Bridges Conference was designed to bring together professionals involved with long-term museum/community relationships, and to offer opportunities to share and develop new strategies to (1) address practical issues inherent in funding, developing
The Exploratorium's Going APE project (APE=Active Prolonged Engagement) developed 30 exhibit designs to encourage visitors to become more cognitively engaged with exhibits--to use exhibits as tools for self-directed exploration, rather than as authoritative demonstrations. To do this, the staff drew on work in the fields of education, visitor research, human factors engineering, computer interface design, and interactive exhibit development at other museums. The project also integrated evaluative research into exhibit development to maximize possibilities for visitor-authored questions
This volume explores how technology-supported learning environments can incorporate physical activity and interactive experiences in formal and informal education. It presents cutting-edge research and design work on a new generation of "body-centric" technologies such as wearable body sensors, GPS tracking devices, interactive display surfaces, video game controller devices, and humanlike avatars. Contributors discuss how and why each of these technologies can be used in service of learning within K-12 classrooms and at home, in museums and online. Citing examples of empirical evidence and
This article describes a transmedia learning experience for early school-aged children. The experience represented an effort to transition a primarily television-based series to a primarily web-based series. Children watched new animation, completed online activities designed to promote STEM (science, technology, engineering, and math) exploration, and participated in (and reported on) offline activities that required them to investigate real-world phenomena. Children were expected to visit the website every weekday, for four weeks, as part of the experience. A single group pre-post test
DATE:
TEAM MEMBERS:
Concord Evaluation GroupJessica AndrewsChristine Paulsen