The Dimensions of Success (DoS) observation tool defines and provides rubrics (with levels 1-4) for 12 dimensions that were developed to measure STEM program quality in out-of-school time. This technical report summarizes the development of the instrument and findings from our initial study that included 284 observations in the field across 58 STEM programs in two geographic regions (New England and the Midwest). Data were collected by 46 trained observers who observed in pairs. This report is the initial step in developing a validity argument for the instrument.
DATE:
TEAM MEMBERS:
Ashima Mathur ShahCaroline WylieDrew Gitomer
The Dimensions of Success observation tool, or DoS, pinpoints twelve indicators of STEM program quality in out-of-school time. It was developed and studied with funding from the National Science Foundation (NSF) by the Program in Education, Afterschool and Resiliency (PEAR), along with partners at Educational Testing Service (ETS) and Project Liftoff. In 2014, a technical report was released, describing the tool and its psychometric properties (http://www.pearweb.org/research/pdfs/DoSTechReport_092314_final.pdf). The DoS observation tool focuses on understanding the quality of a STEM activity in an out-of-school time learning environment and includes an explanation of each dimension and its key indicators, as well as a 4-level rubric with descriptions of increasing quality. Today, over 700 people have been trained to use the DoS tool, and over 12 state networks have adopted DoS to measure the quality of their afterschool STEM programming.
DATE:
-
TEAM MEMBERS:
Program in Education, AfterschoolDr. Ashima ShahDrew Gitomer
Plum Landing (https://pbskids.org/plumlanding/) is produced by WGBH Educational Foundation (http://wgbh.org), the Public Broadcasting Service affiliate based in Boston, MA. The website, Plum Landing, follows the adventures of an animated space alien, named Plum, after her spaceship crash-lands on Earth. With funding from the National Science Foundation, the Corporation for Public Broadcasting, The Kendeda Fund, and the Northern Research Station, Forest Service, U.S. Department of Agriculture. WGBH worked closely with a panel of science advisors to create an “innovative, environmental science
This is a report of an evaluation of the content and design of the science components of the Education Development Center's TV411 program, conducted by Owen Consulting, Inc. In 2010, EDC received a grant from NSF to reconstruct the TV411 website, produce new science content, including videos and web lessons, improve user interactivity, and develop materials to support adult educators who work with the site's target population of low literacy adults. This report lays out the evaluation design, provides an overview of site web metrics, describes the registered user population discusses the ways
DATE:
TEAM MEMBERS:
Education Development CenterEric GraigDavid Owen
How can professional learning for out‐of‐school staff be organized to promote equity in STEM learning? This is the question a group of out-of‐school educators and educational researchers gathered to discuss at the Exploratorium on January 30‐31, 2015. The meeting was sponsored by the Research+Practice Collaboratory, an NSF-‐funded project that develops and tests new models for integrating research and practice perspectives for the improvement of science and mathematics education. Four big ideas for supporting equity-oriented facilitation emerged from the group's discussions: (1) Seeing
This book offers museum learning researchers and practitioners--educators, explainers, and exhibit developers--a new approach for fostering group inquiry at interactive science exhibits. The Juicy Question game, developed at the Exploratorium in San Francisco, engages group members in a simple process of inquiry that helps them work together interrogate exhibit phenomena more deeply. and widens their both families and student field trip groups. The approach is easy to implement and yields clear results. The results are summarized in a set of practice principles that can be used by other
On June 20-22, 2008, the Philadelphia/Camden Informal Science Education Collaborative (PISEC) conducted the Bridges Conference for museum/community partnership programs that serve families. The conference was funded by a National Science Foundation (NSF) grant (DRL# 0734835), which covered planning, implementation, evaluation and dissemination. The Bridges Conference was designed to bring together professionals involved with long-term museum/community relationships, and to offer opportunities to share and develop new strategies to (1) address practical issues inherent in funding, developing
The Exploratorium's Going APE project (APE=Active Prolonged Engagement) developed 30 exhibit designs to encourage visitors to become more cognitively engaged with exhibits--to use exhibits as tools for self-directed exploration, rather than as authoritative demonstrations. To do this, the staff drew on work in the fields of education, visitor research, human factors engineering, computer interface design, and interactive exhibit development at other museums. The project also integrated evaluative research into exhibit development to maximize possibilities for visitor-authored questions
This volume explores how technology-supported learning environments can incorporate physical activity and interactive experiences in formal and informal education. It presents cutting-edge research and design work on a new generation of "body-centric" technologies such as wearable body sensors, GPS tracking devices, interactive display surfaces, video game controller devices, and humanlike avatars. Contributors discuss how and why each of these technologies can be used in service of learning within K-12 classrooms and at home, in museums and online. Citing examples of empirical evidence and
Sustainable Nano is the a blog created and written by scientists at the Center for Sustainable Nanotechnology, a research center located primarily at universities in the midwest that seeks to advance technological innovations that are safe and sustainable by discovering molecular principles that govern nanoparticle-biological interactions, preparing a new and diverse generation of trans-disciplinary scientists, and engaging the general public.
The digital revolution has transformed how young people discover and pursue their interests; how they communicate with and learn from other people; and how they encounter and learn about the world around them. How can we identify best practices for incorporating new media technologies into learning environments in a way that resonates with youth, including their interests, goals, and the ways they use technology in their everyday lives? How do we resolve the need to document and recognize informal STEM learning and connect it to formal education contexts? What strategies can be developed for inspiring and tracking student progress towards the learning goals outlined in the Next Generation Science Standards (NGSS)? These questions are the underlying motivation for this CAREER program of research. Digital badges represent a specific kind of networked technology and have been touted as an alternative credentialing system for recognizing and rewarding learning across domains, both inside and outside of formal education contexts. While there is considerable enthusiasm and speculation around the use of digital badges, the extent to which they succeed at empowering learners and connecting their learning across contexts remains largely untested. This project seeks to fill this gap in knowledge. The approach taken for this program of study is a three phased design-based research effort that will be focused on four objectives: (1) identifying design principles and support structures needed to develop and implement a digital badge system that recognizes informal STEM learning; (2) documenting the opportunities and challenges associated with building a digital badge ecosystem that connects informal learning contexts to formal education and employment opportunities; (3) determining whether and how digital badges support learners' STEM identities; and (4) determining whether and how digital badges help learners to connect their informal STEM learning to formal education and employment opportunities. In Phase 1, an existing prototype created in prior work at Seattle's Pacific Science Center will be developed into a fully functional digital badge system. In Phase 2, the PI will also work collaboratively with higher education stakeholders to establish formal mechanisms for recognizing Pacific Science Center badges in higher education contexts. In Phase 3, the badge ecosystem will be expanded and students' use of and engagement with badges will be tracked as they apply to and enter college. The project involves high school students participating in the Discovery Corps program at the Pacific Science Center, undergraduate and graduate students at the University of Washington, and stakeholders in the K-12 and higher education community in Seattle. Educational activities integrated with this program of research will support: (1) mentoring University of Washington students throughout the project to develop their skills as practice-oriented researchers; (2) incorporating the research processes and findings from the project into university courses aimed at developing students' understanding of the opportunities and challenges associated with using new media technologies to support learning; and (3) using the research findings to develop educational outreach initiatives to support other informal STEM learning institutions in their use of digital badges.
As science centers and children's museums re-define their roles in a society that is increasingly linguistically diverse, many seek to engage more effectively with dual language learners. Dual language learners are young children who are still in the process of acquiring basic language skills in their first language while at the same time acquiring a second language. At present, museum professionals face the challenge of developing programs and practices in the absence of research on informal science education for this population. The Center of Science and Industry (COSI) and The Ohio State University (OSU) will collaborate to begin a systematic study of informal science education programs and practices for reaching and serving preschool dual language learners. The improvement of dual language learners' informal science learning experiences is an increasingly important part of efforts to achieve equity and diversity in participation in science. Such efforts are particularly important as this population grows in number and as the significance of early science learning experiences for later achievement becomes better understood. This project will begin to address the lack of research through three interconnected activities: (1) a national needs assessment of children's museums and science museums, (2) an in-person convening and quarterly virtual meet-ups with teams from eight partner museums, and (3) an exploratory study of COSI's programs and practices to support the access, participation, and learning of preschool dual language learners and their parents/caregivers. The project will yield important insights into current practices and priorities with respect to effective museum engagement with dual language learners, their families, and the early childhood professionals who serve them. The project will (1) produce a comprehensive report on the current state of the field related to providing informal science experiences for preschool dual language learners; (2) identify gaps in existing research and practice, as well as promising foci for future study and improvement and expansion of museum practice; and (3) create a full-scale Research in Service to Practice proposal and a national network of museums to implement the proposal. The overarching goal of the project is to advance the knowledge and awareness of needs and practices related to informal science programming for preschool children who are learning English as an additional language. The national needs assessment will be conducted by means of an online questionnaire sent to museums identified via public association lists, and questions will focus on institutional practices in relation to school readiness and the needs of preschool dual language learners and perceived gaps in services. In the convening and virtual meet-ups, the project team, local community partners, project advisers, museum association leaders, and museum partners selected for their innovative work with linguistically diverse populations will discuss partners' programs, practices and frameworks; emergent project findings; and directions for further study. The exploratory study of COSI programs and practices will entail participant observation, document analysis, and interviews and focus group conversations with stakeholders, including parents, early childhood educators, COSI team members, community organization leaders. The project is funded by the Advancing Informal STEM Learning (AISL) program, which seeks to advance new approaches to, and evidence-based understanding of, the design and development of STEM learning in informal environments. Its funding includes broadening access to and engagement in STEM learning experiences, advancing innovative research on and assessment of STEM learning in informal environments, and developing understandings of deeper learning by participants. An AISL Pathways grant, such as this one, allows practitioners and researchers to undertake exploratory development work that has the potential to produce evidence, findings, and/or deliverables that will form the basis of anticipated further innovative, or potentially transformative, research and development work.